Sep 22 15:30:48 devstack cinder-volume[74954]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 22 15:30:48 devstack cinder-volume[74954]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 22 15:30:48 devstack cinder-volume[74954]: we strongly recommend against using it for new projects.
Sep 22 15:30:48 devstack cinder-volume[74954]: If you are already using Eventlet, we recommend migrating to a different
Sep 22 15:30:48 devstack cinder-volume[74954]: framework.  For more detail see
Sep 22 15:30:48 devstack cinder-volume[74954]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 22 15:30:48 devstack cinder-volume[74954]:   import eventlet  # noqa
Sep 22 15:30:51 devstack cinder-volume[74954]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 22 15:30:51 devstack cinder-volume[74954]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 22 15:30:51 devstack cinder-volume[74954]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 22 15:30:52 devstack cinder-volume[74954]: INFO dbcounter [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Registered counter for database cinder
Sep 22 15:30:52 devstack cinder-volume[74954]: DEBUG oslo_db.sqlalchemy.engines [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74954) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:30:52 devstack cinder-volume[74954]: DEBUG dbcounter [-] [74954] Writer thread running {{(pid=74954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 22 15:30:52 devstack cinder-volume[74954]: INFO cinder.rpc [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 22 15:30:52 devstack cinder-volume[74954]: INFO cinder.rpc [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 22 15:30:52 devstack cinder-volume[74954]: DEBUG oslo_db.sqlalchemy.engines [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74954) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:30:52 devstack cinder-volume[74954]: INFO cinder.volume.manager [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Determined volume DB was empty at startup.
Sep 22 15:30:52 devstack cinder-volume[74954]: DEBUG cinder.volume.manager [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74954) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 22 15:30:52 devstack cinder-volume[74954]: INFO cinder.volume.manager [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 22 15:30:52 devstack cinder-volume[74954]: WARNING stevedore.named [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 22 15:30:52 devstack cinder-volume[74954]: WARNING castellan.key_manager [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 15:30:52 devstack cinder-volume[74954]: WARNING cinder.keymgr.conf_key_mgr [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 15:30:52 devstack cinder-volume[74954]: DEBUG cinder.volume.drivers.lvm [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74954) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 22 15:30:52 devstack cinder-volume[74954]: DEBUG oslo_concurrency.processutils [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_concurrency.processutils [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.428s {{(pid=74954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_db.sqlalchemy.engines [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74954) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:30:53 devstack cinder-volume[74954]: INFO cinder.rpc [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 22 15:30:53 devstack cinder-volume[74954]: INFO cinder.rpc [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 22 15:30:53 devstack cinder-volume[74954]: WARNING stevedore.named [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 22 15:30:53 devstack cinder-volume[74954]: WARNING castellan.key_manager [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 15:30:53 devstack cinder-volume[74954]: INFO cinder.volume.manager [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_db.sqlalchemy.engines [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74954) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:30:53 devstack cinder-volume[74954]: INFO oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Starting 1 workers
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Started child 75116 {{(pid=74954) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Full set of CONF: {{(pid=74954) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] ******************************************************************************** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Configuration options gathered from: {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] ================================================================================ {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] allow_availability_zone_fallback = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] allow_compression_on_image_upload = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] allowed_direct_url_schemes     = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] api_rate_limit                 = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] auth_strategy                  = keystone {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] az_cache_duration              = 3600 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_availability_zone      = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_host                   = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_name                   = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_stats_polling_interval = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backup_api_class               = cinder.backup.api.API {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backup_name_template           = backup-%s {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backup_use_same_host           = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backup_use_temp_snapshot       = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] chap_password                  = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] chap_username                  =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cinder_internal_tenant_project_id = eb0bc1c7137c42e9acd47c16ba6b4d6f {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cinder_internal_tenant_user_id = 5ca9cf5841d64ff5a0c00dbc07dbb0ef {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cloned_volume_same_az          = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cluster                        = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] compression_format             = gzip {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] compute_api_class              = cinder.compute.nova.API {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] config_dir                     = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] config_source                  = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] control_exchange               = openstack {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] debug                          = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] default_availability_zone      = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] default_group_type             = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] default_volume_type            = lvmdriver-1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[75116]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] disk_geometry                  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] driver_client_cert             = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] driver_client_cert_key         = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] driver_data_namespace          = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] driver_ssl_cert_path           = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] driver_ssl_cert_verify         = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] driver_use_ssl                 = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] enable_force_upload            = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] enable_new_services            = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] enable_unsupported_driver      = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] enforce_multipath_for_image_xfer = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] filter_function                = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_api_insecure            = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_api_servers             = ['http://192.168.122.204/image'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_api_ssl_compression     = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_ca_certificates_file    = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_catalog_info            = image:glance:publicURL {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_certfile                = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_keyfile                 = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_num_retries             = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance_request_timeout         = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] goodness_function              = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] graceful_shutdown_timeout      = 5 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] group_api_class                = cinder.group.api.API {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] host                           = devstack {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_compress_on_upload       = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_conversion_address_space_limit = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_conversion_cpu_limit     = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_conversion_disable       = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_introspection_address_space_limit = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_introspection_cpu_limit  = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_upload_use_cinder_backend = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_upload_use_internal_tenant = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_volume_cache_enabled     = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_volume_cache_max_count   = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] image_volume_cache_max_size_gb = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] init_host_max_objects_retrieval = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] iscsi_target_flags             =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] iscsi_write_cache              = on {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] iser_helper                    = tgtadm {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] iser_ip_address                = 192.168.122.204 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] iser_port                      = 3260 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] log_color                      = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] log_config_append              = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] log_dir                        = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] log_file                       = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] log_options                    = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] log_rotate_interval            = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] log_rotate_interval_type       = days {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] log_rotation_type              = none {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] max_age                        = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] max_logfile_count              = 30 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] max_logfile_size_mb            = 200 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] max_over_subscription_ratio    = 20.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] message_reap_interval          = 86400 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] message_ttl                    = 2592000 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] migration_create_volume_timeout_secs = 300 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] monkey_patch                   = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] monkey_patch_modules           = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] my_ip                          = 192.168.122.204 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] no_snapshot_gb_quota           = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] num_iser_scan_tries            = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] num_shell_tries                = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] num_volume_device_scan_tries   = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] nvmeof_conn_info_version       = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] nvmet_ns_id                    = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] nvmet_port_id                  = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] osapi_max_limit                = 1000 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] osapi_volume_ext_list          = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] osapi_volume_listen_port       = 8776 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] osapi_volume_use_ssl           = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] osapi_volume_workers           = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] per_volume_size_limit          = -1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] periodic_fuzzy_delay           = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] periodic_interval              = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] public_endpoint                = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] publish_errors                 = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] quota_backup_gigabytes         = 1000 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] quota_backups                  = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] quota_gigabytes                = 1000 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] quota_groups                   = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] quota_snapshots                = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] quota_volumes                  = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] rate_limit_burst               = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] rate_limit_except_level        = CRITICAL {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] rate_limit_interval            = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] reinit_driver_count            = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] replication_device             = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] report_discard_supported       = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] report_interval                = 120 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] reservation_clean_interval     = 86400 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] reservation_expire             = 86400 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] reserved_image_namespaces      = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] reserved_percentage            = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] rpc_response_timeout           = 120 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] run_external_periodic_tasks    = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] scst_target_driver             = iscsi {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] scst_target_iqn_name           = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_down_time              = 720 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] shell_completion               = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] snapshot_name_template         = snapshot-%s {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] snapshot_same_host             = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] split_loggers                  = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] state_path                     = /opt/stack/data/cinder {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] storage_availability_zone      = nova {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] storage_protocol               = iSCSI {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] syslog_log_facility            = LOG_USER {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] target_helper                  = lioadm {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] target_ip_address              = 192.168.122.204 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] target_port                    = 3260 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] target_protocol                = iscsi {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] target_secondary_ip_addresses  = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] trace_flags                    = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] transport_url                  = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] until_refresh                  = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] use_chap_auth                  = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] use_default_quota_class        = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] use_journal                    = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] use_json                       = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] use_multipath_for_image_xfer   = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] use_stderr                     = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] use_syslog                     = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] verify_glance_signatures       = enabled {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_api_class               = cinder.volume.api.API {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_backend_name            = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[75116]: INFO cinder.volume.manager [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 22 15:30:53 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_clear                   = zero {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_clear_ionice            = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_clear_size              = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_copy_bps_limit          = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_dd_blocksize            = 1M {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_name_template           = volume-%s {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_service_inithost_offload = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volume_usage_audit_period      = month {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] zoning_mode                    = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_concurrency.disable_process_locking = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.auth_section = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.auth_type   = password {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.auth_version = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.cache       = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.certfile    = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.include_service_catalog = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.insecure    = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.interface   = public {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.keyfile     = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_password = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcache_username = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.region_name = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.service_type = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.204/identity {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.backend                  = dogpile.cache.null {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.backend_argument         = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.backend_expiration_time  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.config_prefix            = cache.oslo {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.debug_cache_backend      = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.enable_retry_client      = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.enable_socket_keepalive  = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.enabled                  = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.expiration_time          = 600 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.hashclient_retry_attempts = 2 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.memcache_dead_retry      = 300 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.memcache_sasl_enabled    = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.password                 = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.proxies                  = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.redis_db                 = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.redis_server             = localhost:6379 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.retry_attempts           = 2 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.retry_delay              = 0.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.socket_keepalive_count   = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.socket_keepalive_idle    = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.socket_keepalive_interval = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.socket_timeout           = 1.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.tls_allowed_ciphers      = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.tls_cafile               = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.tls_certfile             = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.tls_enabled              = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.tls_keyfile              = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cache.username                 = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] coordination.backend_url       = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.asyncio_connection    = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.asyncio_slave_connection = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.backend               = sqlalchemy {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.connection            = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.connection_debug      = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.connection_parameters =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.connection_recycle_time = 3600 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.connection_trace      = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.db_inc_retry_interval = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.db_max_retries        = 20 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.db_max_retry_interval = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.db_retry_interval     = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.max_overflow          = 50 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.max_pool_size         = 5 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.max_retries           = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.mysql_wsrep_sync_wait = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.pool_timeout          = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.retry_interval        = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.slave_connection      = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.sqlite_synchronous    = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.synchronous_reader    = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] database.use_db_reconnect      = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_tracing.insecure = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.connection_string     = messaging:// {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.enabled               = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.es_doc_type           = notification {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.es_scroll_size        = 10000 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.es_scroll_time        = 2m {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.filter_error_trace    = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.hmac_keys             = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.sentinel_service_name = mymaster {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.socket_timeout        = 0.1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.trace_requests        = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler.trace_sqlalchemy      = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler_jaeger.process_tags   = {} {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler_jaeger.service_name_prefix = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] profiler_otlp.service_name_prefix = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.enforce_new_defaults = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.policy_default_rule = default {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] privsep_osbrick.group          = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] privsep_osbrick.helper_command = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] privsep_osbrick.user           = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cinder_sys_admin.group         = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cinder_sys_admin.helper_command = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] cinder_sys_admin.user          = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.auth_section      = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.auth_type         = password {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.cafile            = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.certfile          = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.collect_timing    = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.insecure          = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.keyfile           = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.send_service_user_token = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.split_loggers     = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.timeout           = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.tls_ciphers       = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] service_user.tls_min_version   = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.auth_section            = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.auth_type               = password {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.certfile                = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.collect_timing          = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.insecure                = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.keyfile                 = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.region_name             = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.split_loggers           = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.timeout                 = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.tls_ciphers             = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] glance.tls_min_version         = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.backend_availability_zone = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.chap_password = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.chap_username =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.disk_geometry = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.driver_client_cert = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.driver_client_cert_key = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.driver_data_namespace = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.driver_use_ssl = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.extra_capabilities = {} {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.filter_function = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.goodness_function = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.iscsi_target_flags =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.iscsi_write_cache = on {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.iser_helper   = tgtadm {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.iser_ip_address = 192.168.122.204 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.iser_port     = 3260 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.lvm_share_target = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.lvm_type      = auto {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.num_shell_tries = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.replication_device = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.report_discard_supported = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.reserved_percentage = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.target_helper = tgtadm {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.target_ip_address = 192.168.122.204 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.target_port   = 3260 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.target_protocol = iscsi {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.trace_flags   = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.unique_fqdn_network = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.use_chap_auth = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volume_backend_name = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volume_clear  = zero {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volume_clear_ionice = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volume_clear_size = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack sudo[75120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack sudo[75120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_reports.file_event_handler = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_reports.log_dir           = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.backend_host       = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.chap_password      = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.chap_username      = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.disk_geometry      = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.driver_client_cert = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.extra_capabilities = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.filter_function    = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.goodness_function  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.iser_helper        = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.iser_ip_address    = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.iser_port          = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.lvm_share_target   = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.lvm_type           = auto {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.num_shell_tries    = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.replication_device = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.report_discard_supported = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.reserved_percentage = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.scst_target_driver = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.storage_protocol   = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.target_helper      = lioadm {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.target_ip_address  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.target_port        = 3260 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.trace_flags        = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.use_chap_auth      = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volume_clear       = zero {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volume_clear_size  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] lvmdriver-1.volumes_dir        = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_notifications.driver = [] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_notifications.retry = -1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] key_manager.fixed_key          = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.barbican_api_version  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.barbican_endpoint     = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.barbican_endpoint_type = public {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.barbican_region_name  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.cafile                = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.certfile              = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.collect_timing        = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.insecure              = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.keyfile               = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.number_of_retries     = 60 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.retry_delay           = 1 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.send_service_user_token = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.split_loggers         = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.timeout               = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.tls_ciphers           = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.tls_min_version       = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.verify_ssl            = True {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican.verify_ssl_path       = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.auth_section = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.auth_type = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.cafile   = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.certfile = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.collect_timing = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.insecure = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.keyfile  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.split_loggers = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.timeout  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.tls_ciphers = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] barbican_service_user.tls_min_version = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.approle_role_id          = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.approle_secret_id        = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.auth_method              = approle {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.auth_path                = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.kv_mountpoint            = secret {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.kv_path                  = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.kv_version               = 2 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.namespace                = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.root_token_id            = **** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.ssl_ca_crt_file          = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.timeout                  = 60.0 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.token_file               = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.token_role               = None {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.use_ssl                  = False {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:30:53 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] ******************************************************************************** {{(pid=74954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 22 15:30:54 devstack sudo[75120]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:54 devstack sudo[75155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:30:54 devstack sudo[75155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:54 devstack sudo[75155]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.260s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:30:54 devstack cinder-volume[75116]: INFO cinder.brick.local_dev.lvm [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:54 devstack sudo[75290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:30:54 devstack sudo[75290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:54 devstack sudo[75290]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG cinder.brick.local_dev.lvm [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75116) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 22 15:30:54 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:54 devstack sudo[75382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:30:54 devstack sudo[75382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:55 devstack sudo[75382]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:55 devstack sudo[75582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:30:55 devstack sudo[75582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:55 devstack sudo[75582]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.371s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:55 devstack sudo[75760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 22 15:30:55 devstack sudo[75760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:55 devstack sudo[75760]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.340s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:55 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:55 devstack sudo[75765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:30:55 devstack sudo[75765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:56 devstack sudo[75765]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:56 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:56 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:56 devstack sudo[75848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:30:56 devstack sudo[75848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:56 devstack sudo[75848]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:56 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:56 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:56 devstack sudo[75851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:30:56 devstack sudo[75851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:56 devstack sudo[75851]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:56 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:56 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:56 devstack sudo[75914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:30:56 devstack sudo[75914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:57 devstack sudo[75914]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:57 devstack sudo[75944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:30:57 devstack sudo[75944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:57 devstack sudo[75944]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:57 devstack cinder-volume[75116]: INFO cinder.volume.drivers.lvm [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:57 devstack sudo[75954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:30:57 devstack sudo[75954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:57 devstack sudo[75954]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG cinder.volume.drivers.lvm [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Updating volume stats {{(pid=75116) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 22 15:30:57 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:57 devstack sudo[75957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:30:57 devstack sudo[75957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:58 devstack sudo[75957]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:58 devstack sudo[75960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:30:58 devstack sudo[75960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:58 devstack sudo[75960]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:58 devstack sudo[75963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:30:58 devstack sudo[75963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:58 devstack sudo[75963]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:58 devstack sudo[75967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:30:58 devstack sudo[75967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:58 devstack sudo[75967]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:58 devstack cinder-volume[75116]: INFO cinder.volume.driver [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Driver hasn't implemented _init_vendor_properties()
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG cinder.volume.driver [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75116) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG oslo_db.sqlalchemy.engines [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG dbcounter [-] [75116] Writer thread running {{(pid=75116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG cinder.db.api [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Building query based on filter {{(pid=75116) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG cinder.image.image_utils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75116) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 22 15:30:58 devstack cinder-volume[75116]: INFO cinder.keymgr.migration [None req-afcd63e8-72c6-4c05-bbf4-26ac3a48a51c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG cinder.volume.drivers.lvm [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Updating volume stats {{(pid=75116) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 22 15:30:58 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:58 devstack sudo[75970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:30:58 devstack sudo[75970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:59 devstack sudo[75970]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:59 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:59 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:59 devstack sudo[75976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:30:59 devstack sudo[75976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:59 devstack sudo[75976]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:59 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:59 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:59 devstack sudo[75979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:30:59 devstack sudo[75979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:30:59 devstack sudo[75979]: pam_unix(sudo:session): session closed for user root
Sep 22 15:30:59 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:30:59 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:30:59 devstack sudo[75982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:30:59 devstack sudo[75982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:31:00 devstack sudo[75982]: pam_unix(sudo:session): session closed for user root
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG cinder.manager [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Notifying Schedulers of capabilities ... {{(pid=75116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:31:00 devstack cinder-volume[75116]: INFO cinder.volume.manager [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Driver initialization completed successfully.
Sep 22 15:31:00 devstack cinder-volume[75116]: INFO cinder.manager [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Initiating service 2 cleanup
Sep 22 15:31:00 devstack cinder-volume[75116]: INFO cinder.manager [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Service 2 cleanup completed.
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG cinder.service [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Creating RPC server for service cinder-volume {{(pid=75116) start /opt/stack/cinder/cinder/service.py:231}}
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG cinder.service [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75116) start /opt/stack/cinder/cinder/service.py:237}}
Sep 22 15:31:00 devstack cinder-volume[75116]: INFO cinder.volume.manager [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG cinder.volume.drivers.lvm [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Updating volume stats {{(pid=75116) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:31:00 devstack sudo[75985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:31:00 devstack sudo[75985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:31:00 devstack sudo[75985]: pam_unix(sudo:session): session closed for user root
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:31:00 devstack sudo[75989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:31:00 devstack sudo[75989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:31:00 devstack sudo[75989]: pam_unix(sudo:session): session closed for user root
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:31:00 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:31:00 devstack sudo[75996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:31:00 devstack sudo[75996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:31:00 devstack sudo[75996]: pam_unix(sudo:session): session closed for user root
Sep 22 15:31:01 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:31:01 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:31:01 devstack sudo[75999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:31:01 devstack sudo[75999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:31:01 devstack sudo[75999]: pam_unix(sudo:session): session closed for user root
Sep 22 15:31:01 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:31:01 devstack cinder-volume[75116]: INFO cinder.volume.manager [None req-944ef396-671d-465f-8e9c-b72db802fa9c None None] Driver post RPC initialization completed successfully.
Sep 22 15:31:03 devstack cinder-volume[74954]: DEBUG dbcounter [-] [74954] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:31:11 devstack cinder-volume[75116]: DEBUG dbcounter [-] [75116] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:31:11 devstack cinder-volume[75116]: DEBUG dbcounter [-] [75116] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:31:18 devstack cinder-volume[75116]: DEBUG oslo_service.periodic_task [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running periodic task VolumeManager._thread_info {{(pid=75116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:31:18 devstack cinder-volume[75116]: DEBUG cinder.volume.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] thread count: 6 {{(pid=75116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:31:18 devstack cinder-volume[75116]: DEBUG cinder.volume.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] thread info: [<_MainThread(MainThread, started 130314790396032)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130314678014912)>, <Thread(Thread-3 (stat_writer), started daemon 130314676404544)>, <Thread(Rabbit-heartbeat, started daemon 130314680353664)>, <Thread(Thread-5 (_runner), started daemon 130314673479232)>, <Thread(Thread-7 (_runner), started daemon 130314673624832)>] {{(pid=75116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:32:18 devstack cinder-volume[75116]: DEBUG oslo_service.periodic_task [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:32:18 devstack cinder-volume[75116]: DEBUG cinder.volume.drivers.lvm [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Updating volume stats {{(pid=75116) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 22 15:32:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:32:18 devstack sudo[78600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:32:18 devstack sudo[78600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:32:18 devstack sudo[78600]: pam_unix(sudo:session): session closed for user root
Sep 22 15:32:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:32:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:32:18 devstack sudo[78603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:32:18 devstack sudo[78603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:32:18 devstack sudo[78603]: pam_unix(sudo:session): session closed for user root
Sep 22 15:32:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:32:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:32:18 devstack sudo[78606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:32:18 devstack sudo[78606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:32:19 devstack sudo[78606]: pam_unix(sudo:session): session closed for user root
Sep 22 15:32:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:32:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:32:19 devstack sudo[78609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:32:19 devstack sudo[78609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:32:19 devstack sudo[78609]: pam_unix(sudo:session): session closed for user root
Sep 22 15:32:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:32:19 devstack cinder-volume[75116]: DEBUG cinder.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Notifying Schedulers of capabilities ... {{(pid=75116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:32:19 devstack cinder-volume[75116]: DEBUG oslo_service.periodic_task [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running periodic task VolumeManager._thread_info {{(pid=75116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:32:19 devstack cinder-volume[75116]: DEBUG cinder.volume.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] thread count: 6 {{(pid=75116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:32:19 devstack cinder-volume[75116]: DEBUG cinder.volume.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] thread info: [<_MainThread(MainThread, started 130314790396032)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130314678014912)>, <Thread(Thread-3 (stat_writer), started daemon 130314676404544)>, <Thread(Rabbit-heartbeat, started daemon 130314680353664)>, <Thread(Thread-5 (_runner), started daemon 130314673479232)>, <Thread(Thread-7 (_runner), started daemon 130314673624832)>] {{(pid=75116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:33:11 devstack cinder-volume[75116]: DEBUG dbcounter [-] [75116] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:33:18 devstack cinder-volume[75116]: DEBUG oslo_service.periodic_task [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:33:18 devstack cinder-volume[75116]: DEBUG cinder.volume.drivers.lvm [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Updating volume stats {{(pid=75116) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 22 15:33:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:33:18 devstack sudo[81620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:33:18 devstack sudo[81620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:33:18 devstack sudo[81620]: pam_unix(sudo:session): session closed for user root
Sep 22 15:33:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:33:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:33:18 devstack sudo[81623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:33:18 devstack sudo[81623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:33:18 devstack sudo[81623]: pam_unix(sudo:session): session closed for user root
Sep 22 15:33:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:33:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:33:18 devstack sudo[81626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:33:18 devstack sudo[81626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:33:19 devstack sudo[81626]: pam_unix(sudo:session): session closed for user root
Sep 22 15:33:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:33:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:33:19 devstack sudo[81629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:33:19 devstack sudo[81629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:33:19 devstack sudo[81629]: pam_unix(sudo:session): session closed for user root
Sep 22 15:33:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:33:19 devstack cinder-volume[75116]: DEBUG cinder.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Notifying Schedulers of capabilities ... {{(pid=75116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:33:19 devstack cinder-volume[75116]: DEBUG oslo_service.periodic_task [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running periodic task VolumeManager._thread_info {{(pid=75116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:33:19 devstack cinder-volume[75116]: DEBUG cinder.volume.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] thread count: 6 {{(pid=75116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:33:19 devstack cinder-volume[75116]: DEBUG cinder.volume.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] thread info: [<_MainThread(MainThread, started 130314790396032)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130314678014912)>, <Thread(Thread-3 (stat_writer), started daemon 130314676404544)>, <Thread(Rabbit-heartbeat, started daemon 130314680353664)>, <Thread(Thread-5 (_runner), started daemon 130314673479232)>, <Thread(Thread-7 (_runner), started daemon 130314673624832)>] {{(pid=75116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:34:18 devstack cinder-volume[75116]: DEBUG oslo_service.periodic_task [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:34:18 devstack cinder-volume[75116]: DEBUG cinder.volume.drivers.lvm [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Updating volume stats {{(pid=75116) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 22 15:34:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:34:18 devstack sudo[83815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:34:18 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:34:18 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root
Sep 22 15:34:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:34:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:34:18 devstack sudo[83821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:34:18 devstack sudo[83821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:34:18 devstack sudo[83821]: pam_unix(sudo:session): session closed for user root
Sep 22 15:34:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:34:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:34:18 devstack sudo[83824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:34:18 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:34:19 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root
Sep 22 15:34:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:34:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:34:19 devstack sudo[83828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:34:19 devstack sudo[83828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:34:19 devstack sudo[83828]: pam_unix(sudo:session): session closed for user root
Sep 22 15:34:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:34:19 devstack cinder-volume[75116]: DEBUG cinder.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Notifying Schedulers of capabilities ... {{(pid=75116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:35:11 devstack cinder-volume[75116]: DEBUG dbcounter [-] [75116] Writing DB stats cinder:SELECT=1 {{(pid=75116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:35:11 devstack cinder-volume[75116]: DEBUG dbcounter [-] [75116] Writing DB stats cinder:UPDATE=1 {{(pid=75116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:35:17 devstack cinder-volume[74954]: INFO oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Caught SIGTERM, stopping children
Sep 22 15:35:17 devstack cinder-volume[74954]: DEBUG oslo_concurrency.lockutils [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Acquiring lock "singleton_lock" {{(pid=74954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 22 15:35:17 devstack cinder-volume[74954]: DEBUG oslo_concurrency.lockutils [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Acquired lock "singleton_lock" {{(pid=74954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 22 15:35:17 devstack cinder-volume[74954]: DEBUG oslo_concurrency.lockutils [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Releasing lock "singleton_lock" {{(pid=74954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 22 15:35:17 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Stop services. {{(pid=74954) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 22 15:35:17 devstack cinder-volume[74954]: DEBUG oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Killing children. {{(pid=74954) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 22 15:35:17 devstack cinder-volume[74954]: INFO oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Waiting on 1 children to exit
Sep 22 15:35:18 devstack cinder-volume[75116]: DEBUG oslo_service.periodic_task [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:35:18 devstack cinder-volume[75116]: DEBUG cinder.volume.drivers.lvm [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Updating volume stats {{(pid=75116) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 22 15:35:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:18 devstack sudo[85131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 15:35:18 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:18 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:18 devstack sudo[85134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:35:18 devstack sudo[85134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:18 devstack sudo[85134]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:18 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:18 devstack sudo[85137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 15:35:18 devstack sudo[85137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:19 devstack sudo[85137]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:19 devstack sudo[85140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 15:35:19 devstack sudo[85140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:19 devstack sudo[85140]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:19 devstack cinder-volume[75116]: DEBUG cinder.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Notifying Schedulers of capabilities ... {{(pid=75116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:35:19 devstack cinder-volume[75116]: DEBUG oslo_service.periodic_task [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] Running periodic task VolumeManager._thread_info {{(pid=75116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:35:19 devstack cinder-volume[75116]: DEBUG cinder.volume.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] thread count: 6 {{(pid=75116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:35:19 devstack cinder-volume[75116]: DEBUG cinder.volume.manager [None req-09cd681b-f1a0-40c1-a485-d9d36ca3aac8 None None] thread info: [<_MainThread(MainThread, started 130314790396032)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130314678014912)>, <Thread(Thread-3 (stat_writer), started daemon 130314676404544)>, <Thread(Rabbit-heartbeat, started daemon 130314680353664)>, <Thread(Thread-5 (_runner), started daemon 130314673479232)>, <Thread(Thread-7 (_runner), started daemon 130314673624832)>] {{(pid=75116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:35:20 devstack cinder-volume[75116]: DEBUG oslo_concurrency.lockutils [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Acquiring lock "singleton_lock" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 22 15:35:20 devstack cinder-volume[75116]: DEBUG oslo_concurrency.lockutils [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Acquired lock "singleton_lock" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 22 15:35:20 devstack cinder-volume[75116]: DEBUG oslo_concurrency.lockutils [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Releasing lock "singleton_lock" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 22 15:35:20 devstack cinder-volume[75116]: WARNING amqp [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 22 15:35:20 devstack cinder-volume[75116]: WARNING amqp [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 22 15:35:20 devstack cinder-volume[74954]: INFO oslo_service.backend._eventlet.service [None req-1d96a12a-5c57-43fe-87e8-805b50df6fe3 None None] Child 75116 exited with status 0
Sep 22 15:35:20 devstack cinder-volume[85145]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 22 15:35:20 devstack cinder-volume[85145]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 22 15:35:20 devstack cinder-volume[85145]: we strongly recommend against using it for new projects.
Sep 22 15:35:20 devstack cinder-volume[85145]: If you are already using Eventlet, we recommend migrating to a different
Sep 22 15:35:20 devstack cinder-volume[85145]: framework.  For more detail see
Sep 22 15:35:20 devstack cinder-volume[85145]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 22 15:35:20 devstack cinder-volume[85145]:   import eventlet  # noqa
Sep 22 15:35:22 devstack cinder-volume[85145]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 22 15:35:22 devstack cinder-volume[85145]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 22 15:35:22 devstack cinder-volume[85145]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 22 15:35:23 devstack cinder-volume[85145]: INFO dbcounter [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Registered counter for database cinder
Sep 22 15:35:23 devstack cinder-volume[85145]: DEBUG oslo_db.sqlalchemy.engines [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85145) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:35:23 devstack cinder-volume[85145]: DEBUG dbcounter [-] [85145] Writer thread running {{(pid=85145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 22 15:35:23 devstack cinder-volume[85145]: INFO cinder.rpc [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 22 15:35:23 devstack cinder-volume[85145]: INFO cinder.rpc [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 22 15:35:23 devstack cinder-volume[85145]: DEBUG oslo_db.sqlalchemy.engines [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85145) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:35:23 devstack cinder-volume[85145]: INFO cinder.volume.manager [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Determined volume DB was empty at startup.
Sep 22 15:35:23 devstack cinder-volume[85145]: DEBUG cinder.volume.manager [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85145) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 22 15:35:23 devstack cinder-volume[85145]: INFO cinder.volume.manager [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 22 15:35:23 devstack cinder-volume[85145]: WARNING stevedore.named [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 22 15:35:23 devstack cinder-volume[85145]: WARNING castellan.key_manager [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 15:35:23 devstack cinder-volume[85145]: WARNING cinder.keymgr.conf_key_mgr [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 15:35:23 devstack cinder-volume[85145]: INFO cinder.volume.manager [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_db.sqlalchemy.engines [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85145) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:35:24 devstack cinder-volume[85145]: INFO oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Starting 1 workers
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Started child 85365 {{(pid=85145) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Full set of CONF: {{(pid=85145) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] ******************************************************************************** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Configuration options gathered from: {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] ================================================================================ {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] allow_availability_zone_fallback = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] allow_compression_on_image_upload = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] allowed_direct_url_schemes     = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] api_rate_limit                 = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] auth_strategy                  = keystone {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_availability_zone      = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_host                   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_name                   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_stats_polling_interval = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backup_api_class               = cinder.backup.api.API {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backup_name_template           = backup-%s {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backup_use_same_host           = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backup_use_temp_snapshot       = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] chap_password                  = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] chap_username                  =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85365]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cinder_internal_tenant_project_id = eb0bc1c7137c42e9acd47c16ba6b4d6f {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cinder_internal_tenant_user_id = 5ca9cf5841d64ff5a0c00dbc07dbb0ef {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cluster                        = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] compression_format             = gzip {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] config_dir                     = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] config_source                  = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] control_exchange               = openstack {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] debug                          = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] default_availability_zone      = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] default_group_type             = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] default_volume_type            = QuobyteHD {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] disk_geometry                  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] driver_client_cert             = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] driver_client_cert_key         = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] driver_data_namespace          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] driver_ssl_cert_path           = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] driver_ssl_cert_verify         = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] driver_use_ssl                 = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] enable_new_services            = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] enable_unsupported_driver      = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] enforce_multipath_for_image_xfer = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] filter_function                = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_api_insecure            = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_api_servers             = ['http://192.168.122.204/image'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_api_ssl_compression     = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_ca_certificates_file    = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_certfile                = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_keyfile                 = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_num_retries             = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance_request_timeout         = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] goodness_function              = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] graceful_shutdown_timeout      = 5 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] group_api_class                = cinder.group.api.API {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] host                           = devstack {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_compress_on_upload       = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_conversion_address_space_limit = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_conversion_cpu_limit     = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_conversion_disable       = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_introspection_address_space_limit = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_introspection_cpu_limit  = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_upload_use_cinder_backend = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_upload_use_internal_tenant = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_volume_cache_enabled     = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_volume_cache_max_count   = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] image_volume_cache_max_size_gb = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] init_host_max_objects_retrieval = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] iscsi_target_flags             =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] iscsi_write_cache              = on {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] iser_helper                    = tgtadm {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] iser_ip_address                = 192.168.122.204 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] iser_port                      = 3260 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] log_color                      = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] log_config_append              = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] log_dir                        = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] log_file                       = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] log_options                    = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] log_rotate_interval            = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] log_rotate_interval_type       = days {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] log_rotation_type              = none {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] max_age                        = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] max_logfile_count              = 30 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] max_logfile_size_mb            = 200 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] max_over_subscription_ratio    = 20.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] message_reap_interval          = 86400 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] message_ttl                    = 2592000 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] migration_create_volume_timeout_secs = 300 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] monkey_patch                   = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] monkey_patch_modules           = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] my_ip                          = 192.168.122.204 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] no_snapshot_gb_quota           = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] num_iser_scan_tries            = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] num_shell_tries                = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] num_volume_device_scan_tries   = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] nvmeof_conn_info_version       = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] nvmet_ns_id                    = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] nvmet_port_id                  = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] osapi_max_limit                = 1000 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] osapi_volume_ext_list          = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] osapi_volume_listen_port       = 8776 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] osapi_volume_use_ssl           = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] osapi_volume_workers           = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] per_volume_size_limit          = -1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] periodic_fuzzy_delay           = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] periodic_interval              = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] public_endpoint                = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] publish_errors                 = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] quota_backup_gigabytes         = 1000 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] quota_backups                  = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] quota_gigabytes                = 1000 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] quota_groups                   = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] quota_snapshots                = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] quota_volumes                  = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] rate_limit_burst               = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] rate_limit_except_level        = CRITICAL {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] rate_limit_interval            = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] reinit_driver_count            = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] replication_device             = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] report_discard_supported       = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] report_interval                = 120 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] reservation_clean_interval     = 86400 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] reservation_expire             = 86400 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] reserved_image_namespaces      = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] reserved_percentage            = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] rpc_response_timeout           = 120 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] run_external_periodic_tasks    = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] scst_target_driver             = iscsi {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] scst_target_iqn_name           = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_down_time              = 720 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] shell_completion               = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] snapshot_name_template         = snapshot-%s {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] split_loggers                  = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] state_path                     = /opt/stack/data/cinder {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] storage_availability_zone      = nova {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] storage_protocol               = iSCSI {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] syslog_log_facility            = LOG_USER {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] target_helper                  = lioadm {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] target_ip_address              = 192.168.122.204 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] target_port                    = 3260 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] target_protocol                = iscsi {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] target_secondary_ip_addresses  = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] trace_flags                    = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] transport_url                  = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] until_refresh                  = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] use_chap_auth                  = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] use_default_quota_class        = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] use_journal                    = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] use_json                       = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] use_multipath_for_image_xfer   = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] use_stderr                     = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] use_syslog                     = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] verify_glance_signatures       = enabled {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_api_class               = cinder.volume.api.API {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_backend_name            = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_clear                   = zero {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_clear_ionice            = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_clear_size              = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_copy_bps_limit          = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_dd_blocksize            = 1M {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_name_template           = volume-%s {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_service_inithost_offload = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volume_usage_audit_period      = month {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] zoning_mode                    = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_concurrency.disable_process_locking = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85365]: INFO cinder.volume.manager [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG cinder.volume.drivers.remotefs [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85365) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.auth_section = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.auth_type   = password {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.auth_version = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.cache       = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.certfile    = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.include_service_catalog = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.insecure    = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.interface   = public {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.keyfile     = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_password = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcache_username = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.region_name = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.service_type = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.204/identity {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.backend                  = dogpile.cache.null {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.backend_argument         = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.backend_expiration_time  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.config_prefix            = cache.oslo {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.debug_cache_backend      = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.enable_retry_client      = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.enable_socket_keepalive  = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.enabled                  = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.expiration_time          = 600 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.hashclient_retry_attempts = 2 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.memcache_dead_retry      = 300 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.memcache_sasl_enabled    = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.password                 = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.proxies                  = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.redis_db                 = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.redis_server             = localhost:6379 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.retry_attempts           = 2 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.retry_delay              = 0.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.socket_keepalive_count   = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.socket_keepalive_idle    = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.socket_keepalive_interval = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.socket_timeout           = 1.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.tls_allowed_ciphers      = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.tls_cafile               = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.tls_certfile             = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.tls_enabled              = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.tls_keyfile              = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cache.username                 = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] coordination.backend_url       = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.asyncio_connection    = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.asyncio_slave_connection = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.backend               = sqlalchemy {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.connection            = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.connection_debug      = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.connection_parameters =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.connection_recycle_time = 3600 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.connection_trace      = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.db_inc_retry_interval = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.db_max_retries        = 20 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.db_max_retry_interval = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.db_retry_interval     = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.max_overflow          = 50 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.max_pool_size         = 5 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.max_retries           = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.mysql_wsrep_sync_wait = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.pool_timeout          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.retry_interval        = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.slave_connection      = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.sqlite_synchronous    = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.synchronous_reader    = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] database.use_db_reconnect      = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_tracing.insecure = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.connection_string     = messaging:// {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.enabled               = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.es_doc_type           = notification {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.es_scroll_size        = 10000 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.es_scroll_time        = 2m {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.filter_error_trace    = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.hmac_keys             = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.sentinel_service_name = mymaster {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.socket_timeout        = 0.1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.trace_requests        = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler.trace_sqlalchemy      = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler_jaeger.process_tags   = {} {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler_jaeger.service_name_prefix = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] profiler_otlp.service_name_prefix = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.enforce_new_defaults = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.policy_default_rule = default {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] privsep_osbrick.group          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] privsep_osbrick.helper_command = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] privsep_osbrick.user           = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cinder_sys_admin.group         = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cinder_sys_admin.helper_command = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] cinder_sys_admin.user          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.auth_section      = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.auth_type         = password {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.cafile            = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.certfile          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.collect_timing    = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.insecure          = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.keyfile           = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.send_service_user_token = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.split_loggers     = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.timeout           = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.tls_ciphers       = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] service_user.tls_min_version   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.auth_section            = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.auth_type               = password {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.certfile                = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.collect_timing          = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.insecure                = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.keyfile                 = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.region_name             = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.split_loggers           = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.timeout                 = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.tls_ciphers             = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] glance.tls_min_version         = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.backend_availability_zone = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.chap_password = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85365) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 22 15:35:24 devstack cinder-volume[85365]: WARNING cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 22 15:35:24 devstack cinder-volume[85365]: WARNING cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Running cmd (subprocess): mount.quobyte {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.chap_username =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.disk_geometry = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.driver_client_cert = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.driver_client_cert_key = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.driver_data_namespace = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.driver_use_ssl = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.extra_capabilities = {} {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.filter_function = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.goodness_function = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.iscsi_target_flags =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.iscsi_write_cache = on {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.iser_ip_address = 192.168.122.204 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.iser_port     = 3260 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_host      =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_login     = admin {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_mount_options = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_password  = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_private_key =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_share_path =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.num_shell_tries = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.quobyte_volume_url = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.replication_device = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.report_discard_supported = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.reserved_percentage = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.target_helper = tgtadm {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.target_ip_address = 192.168.122.204 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.target_port   = 3260 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.target_protocol = iscsi {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.trace_flags   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.unique_fqdn_network = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.use_chap_auth = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.volume_backend_name = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.volume_clear  = zero {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.volume_clear_ionice = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.volume_clear_size = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_reports.file_event_handler = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_reports.log_dir           = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.backend_availability_zone = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.backend_host         = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.chap_password        = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.chap_username        = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.disk_geometry        = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.driver_client_cert   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.driver_data_namespace = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.extra_capabilities   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.filter_function      = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.goodness_function    = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.iser_helper          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.iser_ip_address      = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.iser_port            = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_host             = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_login            = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_mount_options    = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_password         = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_private_key      = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_share_path       = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.num_shell_tries      = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.replication_device   = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.report_discard_supported = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.reserved_percentage  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.scst_target_driver   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.storage_protocol     = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.target_helper        = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.target_ip_address    = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.target_port          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.target_prefix        = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.target_protocol      = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.trace_flags          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.use_chap_auth        = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.volume_clear         = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.volume_clear_size    = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] QuobyteHD.volumes_dir          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack quobyte-client[85366]: Reading configuration file: /etc/quobyte/client.cfg
Sep 22 15:35:24 devstack quobyte-client[85366]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85365) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85365) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85365) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85365]: INFO cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 ...
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f -c /etc/quobyte/client-cinder.cfg {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_notifications.driver = [] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_notifications.retry = -1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] key_manager.fixed_key          = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.barbican_api_version  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.barbican_endpoint     = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.barbican_endpoint_type = public {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.barbican_region_name  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.cafile                = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.certfile              = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.collect_timing        = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.insecure              = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.keyfile               = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.number_of_retries     = 60 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.retry_delay           = 1 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.send_service_user_token = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.split_loggers         = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.timeout               = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.tls_ciphers           = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.tls_min_version       = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.verify_ssl            = True {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican.verify_ssl_path       = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.auth_section = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.auth_type = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.cafile   = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.certfile = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.collect_timing = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.insecure = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.keyfile  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.split_loggers = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.timeout  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.tls_ciphers = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] barbican_service_user.tls_min_version = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.approle_role_id          = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.approle_secret_id        = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.auth_method              = approle {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.auth_path                = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.kv_mountpoint            = secret {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.kv_path                  = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.kv_version               = 2 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.namespace                = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.root_token_id            = **** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.ssl_ca_crt_file          = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.timeout                  = 60.0 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.token_file               = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.token_role               = None {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.use_ssl                  = False {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:24 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] ******************************************************************************** {{(pid=85145) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 22 15:35:24 devstack sudo[85371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f -c /etc/quobyte/client-cinder.cfg
Sep 22 15:35:24 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:24 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.402s {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:24 devstack cinder-volume[85365]: INFO cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 succeeded
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85365) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.422s {{(pid=85365) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:35:24 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:24 devstack sudo[85470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:35:24 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:25 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.254s {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:25 devstack cinder-volume[85365]: INFO cinder.volume.driver [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Driver hasn't implemented _init_vendor_properties()
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.volume.driver [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5676803588867, 'free_capacity_gb': 1775.5676803588867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85365) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_db.sqlalchemy.engines [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85365) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG dbcounter [-] [85365] Writer thread running {{(pid=85365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.db.api [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Building query based on filter {{(pid=85365) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.image.image_utils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85365) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 22 15:35:25 devstack cinder-volume[85365]: INFO cinder.keymgr.migration [None req-46a0353d-f623-4fc9-af63-e9e277da7ba0 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85365) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85365) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85365) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85365) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85365) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:25 devstack sudo[85473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:35:25 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:25 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.247s {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.manager [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Notifying Schedulers of capabilities ... {{(pid=85365) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:35:25 devstack cinder-volume[85365]: INFO cinder.volume.manager [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Driver initialization completed successfully.
Sep 22 15:35:25 devstack cinder-volume[85365]: INFO cinder.manager [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Initiating service 3 cleanup
Sep 22 15:35:25 devstack cinder-volume[85365]: INFO cinder.manager [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Service 3 cleanup completed.
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.service [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Creating RPC server for service cinder-volume {{(pid=85365) start /opt/stack/cinder/cinder/service.py:231}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.service [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85365) start /opt/stack/cinder/cinder/service.py:237}}
Sep 22 15:35:25 devstack cinder-volume[85365]: INFO cinder.volume.manager [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85365) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85365) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85365) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85365) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85365) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:25 devstack sudo[85476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:35:25 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:25 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_concurrency.processutils [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.256s {{(pid=85365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:25 devstack cinder-volume[85365]: INFO cinder.volume.manager [None req-ef5ee08e-adfd-409a-a024-330738f2d9f1 None None] Driver post RPC initialization completed successfully.
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG oslo_service.periodic_task [None req-a9e74b7c-e06a-47e8-9fee-ff6c9b01c028 None None] Running periodic task VolumeManager._thread_info {{(pid=85365) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.volume.manager [None req-a9e74b7c-e06a-47e8-9fee-ff6c9b01c028 None None] thread count: 6 {{(pid=85365) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:35:25 devstack cinder-volume[85365]: DEBUG cinder.volume.manager [None req-a9e74b7c-e06a-47e8-9fee-ff6c9b01c028 None None] thread info: [<_MainThread(MainThread, started 123723012657280)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123722897856896)>, <Thread(Thread-3 (stat_writer), started daemon 123722897893760)>, <Thread(Rabbit-heartbeat, started daemon 123722896211584)>, <Thread(Thread-5 (_runner), started daemon 123722896346752)>, <Thread(Thread-7 (_runner), started daemon 123722896359104)>] {{(pid=85365) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:35:29 devstack cinder-volume[85145]: INFO oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Caught SIGTERM, stopping children
Sep 22 15:35:29 devstack cinder-volume[85145]: DEBUG oslo_concurrency.lockutils [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Acquiring lock "singleton_lock" {{(pid=85145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 22 15:35:29 devstack cinder-volume[85145]: DEBUG oslo_concurrency.lockutils [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Acquired lock "singleton_lock" {{(pid=85145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 22 15:35:29 devstack cinder-volume[85145]: DEBUG oslo_concurrency.lockutils [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Releasing lock "singleton_lock" {{(pid=85145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 22 15:35:29 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Stop services. {{(pid=85145) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 22 15:35:29 devstack cinder-volume[85145]: DEBUG oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Killing children. {{(pid=85145) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 22 15:35:29 devstack cinder-volume[85145]: INFO oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Waiting on 1 children to exit
Sep 22 15:35:33 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Acquiring lock "singleton_lock" {{(pid=85365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 22 15:35:33 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Acquired lock "singleton_lock" {{(pid=85365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 22 15:35:33 devstack cinder-volume[85365]: DEBUG oslo_concurrency.lockutils [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Releasing lock "singleton_lock" {{(pid=85365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 22 15:35:33 devstack cinder-volume[85365]: WARNING amqp [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 22 15:35:33 devstack cinder-volume[85365]: WARNING amqp [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 22 15:35:33 devstack cinder-volume[85145]: INFO oslo_service.backend._eventlet.service [None req-0e939be7-38da-47ed-af2d-434b867909e1 None None] Child 85365 exited with status 0
Sep 22 15:35:34 devstack cinder-volume[85678]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 22 15:35:34 devstack cinder-volume[85678]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 22 15:35:34 devstack cinder-volume[85678]: we strongly recommend against using it for new projects.
Sep 22 15:35:34 devstack cinder-volume[85678]: If you are already using Eventlet, we recommend migrating to a different
Sep 22 15:35:34 devstack cinder-volume[85678]: framework.  For more detail see
Sep 22 15:35:34 devstack cinder-volume[85678]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 22 15:35:34 devstack cinder-volume[85678]:   import eventlet  # noqa
Sep 22 15:35:37 devstack cinder-volume[85678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 22 15:35:37 devstack cinder-volume[85678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 22 15:35:37 devstack cinder-volume[85678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 22 15:35:37 devstack cinder-volume[85678]: INFO dbcounter [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Registered counter for database cinder
Sep 22 15:35:37 devstack cinder-volume[85678]: DEBUG oslo_db.sqlalchemy.engines [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG dbcounter [-] [85678] Writer thread running {{(pid=85678) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 22 15:35:38 devstack cinder-volume[85678]: INFO cinder.rpc [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 22 15:35:38 devstack cinder-volume[85678]: INFO cinder.rpc [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_db.sqlalchemy.engines [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:35:38 devstack cinder-volume[85678]: INFO cinder.volume.manager [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Determined volume DB was empty at startup.
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG cinder.volume.manager [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85678) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 22 15:35:38 devstack cinder-volume[85678]: WARNING stevedore.named [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 22 15:35:38 devstack cinder-volume[85678]: WARNING castellan.key_manager [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 15:35:38 devstack cinder-volume[85678]: WARNING cinder.keymgr.conf_key_mgr [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 15:35:38 devstack cinder-volume[85678]: INFO cinder.volume.manager [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_db.sqlalchemy.engines [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:35:38 devstack cinder-volume[85678]: INFO oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Starting 1 workers
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Started child 85987 {{(pid=85678) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Full set of CONF: {{(pid=85678) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] ******************************************************************************** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] Configuration options gathered from: {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] ================================================================================ {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] allow_availability_zone_fallback = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] allow_compression_on_image_upload = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85987]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] allowed_direct_url_schemes     = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] api_rate_limit                 = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] auth_strategy                  = keystone {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_availability_zone      = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_host                   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_name                   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_stats_polling_interval = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backup_api_class               = cinder.backup.api.API {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backup_name_template           = backup-%s {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backup_use_same_host           = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backup_use_temp_snapshot       = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] chap_password                  = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] chap_username                  =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cinder_internal_tenant_project_id = eb0bc1c7137c42e9acd47c16ba6b4d6f {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cinder_internal_tenant_user_id = 5ca9cf5841d64ff5a0c00dbc07dbb0ef {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cluster                        = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] compression_format             = gzip {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] compute_api_class              = cinder.compute.nova.API {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] config_dir                     = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] config_source                  = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] control_exchange               = openstack {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] debug                          = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] default_availability_zone      = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] default_group_type             = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] default_volume_type            = QuobyteHD {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] disk_geometry                  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] driver_client_cert             = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] driver_client_cert_key         = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] driver_data_namespace          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] driver_ssl_cert_path           = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] driver_ssl_cert_verify         = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] driver_use_ssl                 = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] enable_new_services            = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] enable_unsupported_driver      = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] enabled_backends               = ['QuobyteHD'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] enforce_multipath_for_image_xfer = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] filter_function                = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_api_insecure            = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_api_servers             = ['http://192.168.122.204/image'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_api_ssl_compression     = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_ca_certificates_file    = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_catalog_info            = image:glance:publicURL {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_certfile                = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_keyfile                 = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_num_retries             = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance_request_timeout         = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] goodness_function              = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] graceful_shutdown_timeout      = 5 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] group_api_class                = cinder.group.api.API {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] host                           = devstack {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_compress_on_upload       = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_conversion_address_space_limit = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_conversion_cpu_limit     = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_conversion_disable       = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_introspection_address_space_limit = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_introspection_cpu_limit  = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_upload_use_cinder_backend = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_upload_use_internal_tenant = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_volume_cache_enabled     = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_volume_cache_max_count   = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] image_volume_cache_max_size_gb = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] init_host_max_objects_retrieval = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85987) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] instance_format                = [instance: %(uuid)s]  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] iscsi_target_flags             =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] iscsi_write_cache              = on {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] iser_helper                    = tgtadm {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] iser_ip_address                = 192.168.122.204 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] iser_port                      = 3260 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] log_color                      = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] log_config_append              = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] log_dir                        = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] log_file                       = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] log_options                    = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] log_rotate_interval            = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] log_rotate_interval_type       = days {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] log_rotation_type              = none {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] max_age                        = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] max_logfile_count              = 30 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] max_logfile_size_mb            = 200 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] max_over_subscription_ratio    = 20.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] message_reap_interval          = 86400 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] message_ttl                    = 2592000 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] migration_create_volume_timeout_secs = 300 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] monkey_patch                   = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] monkey_patch_modules           = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] my_ip                          = 192.168.122.204 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] no_snapshot_gb_quota           = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] num_iser_scan_tries            = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] num_shell_tries                = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] num_volume_device_scan_tries   = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] nvmeof_conn_info_version       = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] nvmet_ns_id                    = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] nvmet_port_id                  = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] osapi_max_limit                = 1000 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] osapi_volume_ext_list          = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] osapi_volume_listen_port       = 8776 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] osapi_volume_use_ssl           = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] osapi_volume_workers           = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] per_volume_size_limit          = -1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] periodic_fuzzy_delay           = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] periodic_interval              = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] public_endpoint                = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] publish_errors                 = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] quota_backup_gigabytes         = 1000 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] quota_backups                  = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] quota_gigabytes                = 1000 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] quota_groups                   = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] quota_snapshots                = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] quota_volumes                  = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] rate_limit_burst               = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] rate_limit_except_level        = CRITICAL {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] rate_limit_interval            = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] reinit_driver_count            = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] replication_device             = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] report_discard_supported       = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] report_interval                = 120 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] reservation_clean_interval     = 86400 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] reservation_expire             = 86400 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] reserved_image_namespaces      = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] reserved_percentage            = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] rpc_response_timeout           = 120 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] run_external_periodic_tasks    = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] scst_target_driver             = iscsi {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] scst_target_iqn_name           = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_down_time              = 720 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] shell_completion               = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] snapshot_name_template         = snapshot-%s {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] split_loggers                  = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] state_path                     = /opt/stack/data/cinder {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] storage_availability_zone      = nova {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] storage_protocol               = iSCSI {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] syslog_log_facility            = LOG_USER {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] target_helper                  = lioadm {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] target_ip_address              = 192.168.122.204 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] target_port                    = 3260 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] target_protocol                = iscsi {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] target_secondary_ip_addresses  = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] trace_flags                    = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] transport_url                  = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] until_refresh                  = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] use_chap_auth                  = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] use_default_quota_class        = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] use_journal                    = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] use_json                       = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] use_multipath_for_image_xfer   = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] use_stderr                     = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] use_syslog                     = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] verify_glance_signatures       = enabled {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_api_class               = cinder.volume.api.API {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_backend_name            = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_clear                   = zero {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_clear_ionice            = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_clear_size              = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_copy_bps_limit          = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_dd_blocksize            = 1M {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_name_template           = volume-%s {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_service_inithost_offload = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volume_usage_audit_period      = month {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] zoning_mode                    = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_concurrency.disable_process_locking = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.auth_section = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.auth_type   = password {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.auth_version = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.cache       = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.certfile    = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.delay_auth_decision = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.http_connect_timeout = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.include_service_catalog = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.insecure    = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.interface   = public {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.keyfile     = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_password = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85987) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.quobyte [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcache_username = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.quobyte [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.region_name = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.service_token_roles_required = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.service_type = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.token_cache_time = 300 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.204/identity {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.backend                  = dogpile.cache.null {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Running cmd (subprocess): mount.quobyte {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.backend_argument         = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.backend_expiration_time  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.config_prefix            = cache.oslo {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.debug_cache_backend      = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.enable_retry_client      = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.enable_socket_keepalive  = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.enabled                  = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.expiration_time          = 600 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.hashclient_retry_attempts = 2 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.memcache_dead_retry      = 300 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.memcache_pool_maxsize    = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.memcache_sasl_enabled    = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.password                 = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.proxies                  = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.redis_db                 = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.redis_sentinel_service_name = mymaster {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.redis_server             = localhost:6379 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.retry_attempts           = 2 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.retry_delay              = 0.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.socket_keepalive_count   = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.socket_keepalive_idle    = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.socket_keepalive_interval = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.socket_timeout           = 1.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.tls_allowed_ciphers      = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.tls_cafile               = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.tls_certfile             = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.tls_enabled              = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.tls_keyfile              = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cache.username                 = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] coordination.backend_url       = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.asyncio_connection    = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.asyncio_slave_connection = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.backend               = sqlalchemy {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.connection            = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.connection_debug      = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.connection_parameters =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.connection_recycle_time = 3600 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.connection_trace      = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.db_inc_retry_interval = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.db_max_retries        = 20 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.db_max_retry_interval = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.db_retry_interval     = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.max_overflow          = 50 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.max_pool_size         = 5 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.max_retries           = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.mysql_wsrep_sync_wait = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.pool_timeout          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.retry_interval        = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.slave_connection      = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.sqlite_synchronous    = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.synchronous_reader    = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] database.use_db_reconnect      = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_tracing.insecure = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.connection_string     = messaging:// {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.enabled               = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.es_doc_type           = notification {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.es_scroll_size        = 10000 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.es_scroll_time        = 2m {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.filter_error_trace    = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.hmac_keys             = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.sentinel_service_name = mymaster {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.socket_timeout        = 0.1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.trace_requests        = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler.trace_sqlalchemy      = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler_jaeger.process_tags   = {} {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler_jaeger.service_name_prefix = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] profiler_otlp.service_name_prefix = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.enforce_new_defaults = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.policy_default_rule = default {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.policy_file        = policy.yaml {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] privsep_osbrick.group          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] privsep_osbrick.helper_command = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] privsep_osbrick.user           = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cinder_sys_admin.group         = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cinder_sys_admin.helper_command = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] cinder_sys_admin.user          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.auth_section      = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.auth_type         = password {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.cafile            = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.certfile          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.collect_timing    = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.insecure          = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.keyfile           = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.send_service_user_token = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.split_loggers     = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.timeout           = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.tls_ciphers       = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] service_user.tls_min_version   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.auth_section            = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.auth_type               = password {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.certfile                = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.collect_timing          = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.insecure                = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.keyfile                 = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.region_name             = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.split_loggers           = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.timeout                 = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.tls_ciphers             = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] glance.tls_min_version         = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.backend_availability_zone = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.chap_password = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.chap_username =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.disk_geometry = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.driver_client_cert = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.driver_client_cert_key = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.driver_data_namespace = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.driver_use_ssl = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.enable_unsupported_driver = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.extra_capabilities = {} {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.filter_function = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack quobyte-client[85989]: Reading configuration file: /etc/quobyte/client.cfg
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.goodness_function = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack quobyte-client[85989]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.iscsi_target_flags =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.iscsi_write_cache = on {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.iser_helper   = tgtadm {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.iser_ip_address = 192.168.122.204 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.iser_port     = 3260 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_host      =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_login     = admin {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_mount_options = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_password  = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_private_key =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_share_path =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.num_shell_tries = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.nvmet_port_id = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.quobyte_client_cfg = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.quobyte_volume_url = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.replication_device = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.report_discard_supported = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.reserved_percentage = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.scst_target_driver = iscsi {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.scst_target_iqn_name = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.storage_protocol = iSCSI {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.target_helper = tgtadm {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.target_ip_address = 192.168.122.204 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.target_port   = 3260 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.target_protocol = iscsi {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.trace_flags   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.unique_fqdn_network = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.use_chap_auth = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.volume_backend_name = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.volume_clear  = zero {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.volume_clear_ionice = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.volume_clear_size = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_reports.file_event_handler = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_reports.log_dir           = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.backend_availability_zone = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.backend_host         = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.chap_password        = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.chap_username        = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.chiscsi_conf         = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.disk_geometry        = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.driver_client_cert   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.driver_client_cert_key = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.driver_data_namespace = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.driver_use_ssl       = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.extra_capabilities   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.filter_function      = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.goodness_function    = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.iser_helper          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.iser_ip_address      = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.iser_port            = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.iser_target_prefix   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_host             = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_login            = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_mount_options    = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_password         = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_private_key      = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_share_path       = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_ssh_port         = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.num_shell_tries      = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.nvmet_port_id        = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.replication_device   = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.report_discard_supported = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.reserved_percentage  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.scst_target_driver   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.storage_protocol     = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.target_helper        = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.target_ip_address    = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.target_port          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.target_prefix        = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.target_protocol      = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.trace_flags          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.use_chap_auth        = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.volume_clear         = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.volume_clear_size    = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] QuobyteHD.volumes_dir          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.ssl      = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_notifications.driver = [] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_notifications.retry = -1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] oslo_messaging_notifications.transport_url = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] key_manager.fixed_key          = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.barbican_api_version  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.barbican_endpoint     = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.barbican_endpoint_type = public {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.barbican_region_name  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.cafile                = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.certfile              = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.collect_timing        = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.insecure              = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.keyfile               = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.number_of_retries     = 60 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.retry_delay           = 1 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.send_service_user_token = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack sudo[85997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:35:38 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.split_loggers         = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.timeout               = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.tls_ciphers           = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.tls_min_version       = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.verify_ssl            = True {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican.verify_ssl_path       = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.auth_section = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.auth_type = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.cafile   = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.certfile = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.collect_timing = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.insecure = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.keyfile  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.split_loggers = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.timeout  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.tls_ciphers = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] barbican_service_user.tls_min_version = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.approle_role_id          = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.approle_secret_id        = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.auth_method              = approle {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.auth_path                = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.kv_mountpoint            = secret {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.kv_path                  = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.kv_version               = 2 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.namespace                = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.root_token_id            = **** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.ssl_ca_crt_file          = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.timeout                  = 60.0 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.token_file               = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.token_role               = None {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.use_ssl                  = False {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 22 15:35:38 devstack cinder-volume[85678]: DEBUG oslo_service.backend._eventlet.service [None req-fe5b8599-b1f0-4cf9-867d-3fa80f0b8acb None None] ******************************************************************************** {{(pid=85678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 22 15:35:38 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.253s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:38 devstack cinder-volume[85987]: INFO cinder.volume.driver [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Driver hasn't implemented _init_vendor_properties()
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG cinder.volume.driver [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5676803588867, 'free_capacity_gb': 1775.5676803588867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85987) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_db.sqlalchemy.engines [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85987) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writer thread running {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG cinder.db.api [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Building query based on filter {{(pid=85987) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85987) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:35:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:38 devstack cinder-volume[85987]: INFO cinder.keymgr.migration [None req-abd59e5a-16e1-4559-9659-7f6a4b7055ce None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 22 15:35:39 devstack sudo[86008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:35:39 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:39 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.240s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:35:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Driver initialization completed successfully.
Sep 22 15:35:39 devstack cinder-volume[85987]: INFO cinder.manager [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Initiating service 3 cleanup
Sep 22 15:35:39 devstack cinder-volume[85987]: INFO cinder.manager [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Service 3 cleanup completed.
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG cinder.service [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Creating RPC server for service cinder-volume {{(pid=85987) start /opt/stack/cinder/cinder/service.py:231}}
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG cinder.service [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85987) start /opt/stack/cinder/cinder/service.py:237}}
Sep 22 15:35:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:35:39 devstack sudo[86021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:35:39 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:35:39 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root
Sep 22 15:35:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.238s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:35:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9e4ce42f-55db-4d99-9ad4-9f019e7e6665 None None] Driver post RPC initialization completed successfully.
Sep 22 15:35:48 devstack cinder-volume[85678]: DEBUG dbcounter [-] [85678] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85678) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:35:49 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:35:49 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=2 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:36:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:36:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 6 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:36:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Flow 'volume_create_manager' (6095f7f1-592d-4f36-8be3-d9b731fb1973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e42e02-84f9-48b4-ad06-38c4e2b09135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e42e02-84f9-48b4-ad06-38c4e2b09135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2141165424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3aabd92-f442-430a-93fe-ebb598f68264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152b37c547859565cf11cf9f0c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:36:36Z,use_quota=True,user_id='0ab7dbcdd16b4766a69194fdf423ab3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba6424b-6235-4979-b560-88054c994767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba6424b-6235-4979-b560-88054c994767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90602e39-1f9e-4676-a379-9c5e0028ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90602e39-1f9e-4676-a379-9c5e0028ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3aabd92-f442-430a-93fe-ebb598f68264', 'volume_name': 'volume-a3aabd92-f442-430a-93fe-ebb598f68264', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ffba78-bbcc-42a2-9de6-e2e683736b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ffba78-bbcc-42a2-9de6-e2e683736b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c241ec0-febe-4963-ab54-3b2f3ace0d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:36:35 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Volume a3aabd92-f442-430a-93fe-ebb598f68264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3aabd92-f442-430a-93fe-ebb598f68264', 'volume_size': 1}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2141165424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3aabd92-f442-430a-93fe-ebb598f68264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152b37c547859565cf11cf9f0c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:36:36Z,use_quota=True,user_id='0ab7dbcdd16b4766a69194fdf423ab3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Creating volume a3aabd92-f442-430a-93fe-ebb598f68264 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:36:35 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:36:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:36:36 devstack sudo[86481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264 1073741824
Sep 22 15:36:36 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:36:36 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root
Sep 22 15:36:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264 1073741824" returned: 0 in 0.594s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:36:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:36:36 devstack sudo[86799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264
Sep 22 15:36:36 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:36:36 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root
Sep 22 15:36:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264" returned: 0 in 0.303s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:36:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:36:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:36:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c241ec0-febe-4963-ab54-3b2f3ace0d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3aabd92-f442-430a-93fe-ebb598f68264', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:36:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f69bb2-7c95-463c-aa55-21d0018ed6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:36:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Volume volume-a3aabd92-f442-430a-93fe-ebb598f68264 (a3aabd92-f442-430a-93fe-ebb598f68264): created successfully
Sep 22 15:36:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f69bb2-7c95-463c-aa55-21d0018ed6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:36:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Flow 'volume_create_manager' (6095f7f1-592d-4f36-8be3-d9b731fb1973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:36:37 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6504a0e9-d7e5-4569-914a-0f5ba1bc5ef2 tempest-TaggedAttachmentsTest-1694857199 None] Created volume successfully.
Sep 22 15:36:46 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:36:47 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Flow 'volume_create_manager' (b949fdd8-81bf-4c25-9521-0d3f165bb720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b804c7-1e99-4c55-98d3-8b2276e0967e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b804c7-1e99-4c55-98d3-8b2276e0967e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-749914116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bbec8f-1a8d-43a6-8599-33f8ded01447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c640d99dd1a4aebb233ba7d03729b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:06Z,use_quota=True,user_id='48edf8125c78439e8730558f5ea1ca8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d829b95-5089-461b-bd2c-cc88ee77e24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d829b95-5089-461b-bd2c-cc88ee77e24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd314e1-b0e6-4c3d-b310-ba95c93ffae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd314e1-b0e6-4c3d-b310-ba95c93ffae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6bbec8f-1a8d-43a6-8599-33f8ded01447', 'volume_name': 'volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d951fd3a-244c-4952-a5f6-144c08e7a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d951fd3a-244c-4952-a5f6-144c08e7a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e76d885-a2ee-46bc-9e33-92c30dc6ad1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:06 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Volume c6bbec8f-1a8d-43a6-8599-33f8ded01447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447', 'volume_size': 1}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-749914116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bbec8f-1a8d-43a6-8599-33f8ded01447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c640d99dd1a4aebb233ba7d03729b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:06Z,use_quota=True,user_id='48edf8125c78439e8730558f5ea1ca8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Creating volume c6bbec8f-1a8d-43a6-8599-33f8ded01447 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:37:06 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:37:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:37:06 devstack sudo[87324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447 1073741824
Sep 22 15:37:06 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:37:07 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root
Sep 22 15:37:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447 1073741824" returned: 0 in 0.945s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:37:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:37:07 devstack sudo[87332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447
Sep 22 15:37:07 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:37:08 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root
Sep 22 15:37:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447" returned: 0 in 0.638s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:37:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:37:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:37:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e76d885-a2ee-46bc-9e33-92c30dc6ad1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861aa5cf-fb0b-44c6-9d6e-dd0e64e7fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:08 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Volume volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447 (c6bbec8f-1a8d-43a6-8599-33f8ded01447): created successfully
Sep 22 15:37:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861aa5cf-fb0b-44c6-9d6e-dd0e64e7fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Flow 'volume_create_manager' (b949fdd8-81bf-4c25-9521-0d3f165bb720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:37:08 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b1dfa036-437f-4a88-9081-59e1ac3d630d tempest-ServerRescueNegativeTestJSON-157428136 None] Created volume successfully.
Sep 22 15:37:17 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:37:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Flow 'volume_create_manager' (cd753ea7-2ad3-48c4-b88e-eed184a61c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed92f84-1f7e-4d0f-9c18-59b52e4997b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed92f84-1f7e-4d0f-9c18-59b52e4997b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1196640989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585b9430-00a1-4a50-8d2e-46d845bf2707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2946baaefb44b2384b9403af34307ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:18Z,use_quota=True,user_id='5b6faf859fda4f40bff378004f324a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750fe710-7be5-4ff0-9079-223ae279ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750fe710-7be5-4ff0-9079-223ae279ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8520c11-4517-43f9-a2a8-2a4f8a8527df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8520c11-4517-43f9-a2a8-2a4f8a8527df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585b9430-00a1-4a50-8d2e-46d845bf2707', 'volume_name': 'volume-585b9430-00a1-4a50-8d2e-46d845bf2707', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7324d6-87cf-4bb8-8870-d8bcb2cd7e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7324d6-87cf-4bb8-8870-d8bcb2cd7e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2170cf-e72f-4b00-8c96-8b3321559f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:18 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Volume 585b9430-00a1-4a50-8d2e-46d845bf2707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585b9430-00a1-4a50-8d2e-46d845bf2707', 'volume_size': 1}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1196640989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585b9430-00a1-4a50-8d2e-46d845bf2707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2946baaefb44b2384b9403af34307ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:37:18Z,use_quota=True,user_id='5b6faf859fda4f40bff378004f324a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Creating volume 585b9430-00a1-4a50-8d2e-46d845bf2707 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:37:18 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:37:18 devstack sudo[87423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707 1073741824
Sep 22 15:37:18 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:37:18 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root
Sep 22 15:37:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707 1073741824" returned: 0 in 0.820s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:37:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:37:19 devstack sudo[87456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707
Sep 22 15:37:19 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:37:19 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root
Sep 22 15:37:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707" returned: 0 in 0.505s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:37:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:37:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:37:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2170cf-e72f-4b00-8c96-8b3321559f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585b9430-00a1-4a50-8d2e-46d845bf2707', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf22709d-f493-4553-a36e-fc1ebb83f562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:37:19 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Volume volume-585b9430-00a1-4a50-8d2e-46d845bf2707 (585b9430-00a1-4a50-8d2e-46d845bf2707): created successfully
Sep 22 15:37:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf22709d-f493-4553-a36e-fc1ebb83f562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:37:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Flow 'volume_create_manager' (cd753ea7-2ad3-48c4-b88e-eed184a61c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:37:19 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-07d6a1c5-1f9a-42e4-a3ce-f138f6fdefd1 tempest-AttachVolumeShelveTestJSON-1539838210 None] Created volume successfully.
Sep 22 15:37:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Acquiring lock "cinder-c6bbec8f-1a8d-43a6-8599-33f8ded01447-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:37:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "cinder-c6bbec8f-1a8d-43a6-8599-33f8ded01447-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:37:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Acquiring lock "cinder-quobyte-c6bbec8f-1a8d-43a6-8599-33f8ded01447" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:37:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "cinder-quobyte-c6bbec8f-1a8d-43a6-8599-33f8ded01447" acquired by "delete_volume" :: waited 0.035s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:37:23 devstack cinder-volume[85987]: INFO oslo.privsep.daemon [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4snx1d53/privsep.sock']
Sep 22 15:37:23 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4snx1d53/privsep.sock
Sep 22 15:37:23 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:37:25 devstack cinder-volume[85987]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 22 15:37:25 devstack cinder-volume[85987]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 22 15:37:25 devstack cinder-volume[85987]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 22 15:37:25 devstack cinder-volume[85987]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 22 15:37:25 devstack cinder-volume[85987]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 22 15:37:25 devstack cinder-volume[85987]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 22 15:37:25 devstack cinder-volume[85987]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 22 15:37:25 devstack cinder-volume[85987]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 22 15:37:25 devstack cinder-volume[85987]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 22 15:37:25 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Sep 22 15:37:25 devstack cinder-volume[85987]: INFO oslo.privsep.daemon [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Spawned new privsep daemon via rootwrap
Sep 22 15:37:25 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Accepted privsep connection to /tmp/tmp4snx1d53/privsep.sock {{(pid=85987) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 22 15:37:25 devstack cinder-volume[85987]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 22 15:37:25 devstack cinder-volume[85987]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 22 15:37:25 devstack cinder-volume[85987]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 22 15:37:25 devstack cinder-volume[85987]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87525
Sep 22 15:37:25 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[040780a0-9141-41a0-9e1e-98193b80d671]: (2,) {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:37:25 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b11bf6-6d0e-4281-b3e2-309e6800cdca]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:37:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:37:25 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447
Sep 22 15:37:25 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:37:26 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447" returned: 0 in 0.655s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:37:26 devstack sudo[87532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447
Sep 22 15:37:26 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:37:26 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c6bbec8f-1a8d-43a6-8599-33f8ded01447" returned: 0 in 0.335s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "cinder-quobyte-c6bbec8f-1a8d-43a6-8599-33f8ded01447" released by "delete_volume" :: held 2.964s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:37:26 devstack cinder-volume[85987]: WARNING cinder.quota [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:37:26 devstack cinder-volume[85987]: WARNING cinder.quota [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Created reservations ['0b217dcb-ee04-4d97-b474-7e31ec808a9a', 'e13399cb-a238-49f6-afc0-ef986d6c69dd', '66ee9006-c296-4da2-a097-8787d7ac0eea', 'be4ac4da-fe7f-4aec-acc3-00e41f78b009'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:37:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:37:26 devstack sudo[87535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:37:26 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:37:27 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root
Sep 22 15:37:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.473s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:37:27 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:37:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Deleted volume successfully.
Sep 22 15:37:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e5064fe-925b-460b-83fe-20be78335a4a tempest-ServerRescueNegativeTestJSON-157428136 None] Lock "cinder-c6bbec8f-1a8d-43a6-8599-33f8ded01447-delete_volume" released by "delete_volume" :: held 3.881s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:37:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:37:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:37:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:37:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:37:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:37:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:37:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:37:28 devstack sudo[87564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:37:28 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:37:29 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root
Sep 22 15:37:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.402s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:37:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:37:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:37:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 8 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:37:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:37:35 devstack cinder-volume[85987]: WARNING py.warnings [req-538c6e98-3d31-4e79-82b8-b4dccad6c679 req-6feb4566-278d-4bb1-9ec5-cf19cec64329 tempest-AttachVolumeShelveTestJSON-1539838210 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Sep 22 15:37:35 devstack cinder-volume[85987]:   .first()
Sep 22 15:37:35 devstack cinder-volume[85987]: 
Sep 22 15:37:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-538c6e98-3d31-4e79-82b8-b4dccad6c679 req-6feb4566-278d-4bb1-9ec5-cf19cec64329 tempest-AttachVolumeShelveTestJSON-1539838210 None] No connector for attachment 212d2e88-9909-4a49-ad25-4a811a66fd59; skipping storage backend terminate_connection call. {{(pid=85987) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 22 15:37:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-538c6e98-3d31-4e79-82b8-b4dccad6c679 req-6feb4566-278d-4bb1-9ec5-cf19cec64329 tempest-AttachVolumeShelveTestJSON-1539838210 None] Deleting attachment 212d2e88-9909-4a49-ad25-4a811a66fd59. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:37:37 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=3 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:37:49 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=17,cinder:SELECT=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:37:49 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:37:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-4e620f33-1df8-46a2-926d-a2b2b3ec2a38 req-19703c3f-a724-4592-b894-784c677f10ad tempest-TaggedAttachmentsTest-1694857199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:37:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-4e620f33-1df8-46a2-926d-a2b2b3ec2a38 req-19703c3f-a724-4592-b894-784c677f10ad tempest-TaggedAttachmentsTest-1694857199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:37:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-4e620f33-1df8-46a2-926d-a2b2b3ec2a38 req-19703c3f-a724-4592-b894-784c677f10ad tempest-TaggedAttachmentsTest-1694857199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:37:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4e620f33-1df8-46a2-926d-a2b2b3ec2a38 req-19703c3f-a724-4592-b894-784c677f10ad tempest-TaggedAttachmentsTest-1694857199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-a3aabd92-f442-430a-93fe-ebb598f68264', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91d29dc3-b457-4f08-8e36-0f4b1849c311', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:37:55 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-4e620f33-1df8-46a2-926d-a2b2b3ec2a38 req-19703c3f-a724-4592-b894-784c677f10ad tempest-TaggedAttachmentsTest-1694857199 None] attachment_update completed successfully.
Sep 22 15:38:02 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-ed3a27ad-cbef-4e87-bc47-7d5093d6653c req-c1c0fa89-c658-4ae8-aa47-f77b602f931a tempest-TaggedAttachmentsTest-1694857199 None] Terminate volume connection completed successfully.
Sep 22 15:38:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-ed3a27ad-cbef-4e87-bc47-7d5093d6653c req-c1c0fa89-c658-4ae8-aa47-f77b602f931a tempest-TaggedAttachmentsTest-1694857199 None] Deleting attachment 91d29dc3-b457-4f08-8e36-0f4b1849c311. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:38:12 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=8 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:38:12 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:38:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Acquiring lock "cinder-a3aabd92-f442-430a-93fe-ebb598f68264-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Lock "cinder-a3aabd92-f442-430a-93fe-ebb598f68264-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Acquiring lock "cinder-quobyte-a3aabd92-f442-430a-93fe-ebb598f68264" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Lock "cinder-quobyte-a3aabd92-f442-430a-93fe-ebb598f68264" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:18 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba6fdd-8be5-4ea4-b141-9771b818b873]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:38:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:18 devstack sudo[88472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264
Sep 22 15:38:18 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:18 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264" returned: 0 in 0.730s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:18 devstack sudo[88478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264
Sep 22 15:38:18 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:19 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a3aabd92-f442-430a-93fe-ebb598f68264" returned: 0 in 0.913s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Lock "cinder-quobyte-a3aabd92-f442-430a-93fe-ebb598f68264" released by "delete_volume" :: held 1.755s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:19 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Created reservations ['8d59da5d-c442-4c45-b5ec-ad3ae97caade', '7e599aa3-da49-4106-b614-c88d8b5841af', '26e699a8-2067-4655-86ae-6692d199f28c', '0eb3fc05-a119-4aa0-9b64-6e739f144e62'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:38:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:19 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:38:19 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:20 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.693s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:20 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:38:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Deleted volume successfully.
Sep 22 15:38:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2664332d-0472-4a9f-9964-1d54a816c4dc tempest-TaggedAttachmentsTest-1694857199 None] Lock "cinder-a3aabd92-f442-430a-93fe-ebb598f68264-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:27 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:38:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Flow 'volume_create_manager' (8bc2a329-de07-44ab-8342-75d8b25e219b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9993a83-cc93-43aa-8bd5-3b412135cfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9993a83-cc93-43aa-8bd5-3b412135cfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-527929059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2813d7a-fd6f-4b79-ba79-15e60f333769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e558e7e81c1428997029837ed9a6b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:28Z,use_quota=True,user_id='823c7d6baab04c43b8374cdb44c43412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b9b227-5135-4fcb-9e7d-ae3390c33330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b9b227-5135-4fcb-9e7d-ae3390c33330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93dde56-aca0-4ee1-92c5-0d4c645704e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93dde56-aca0-4ee1-92c5-0d4c645704e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2813d7a-fd6f-4b79-ba79-15e60f333769', 'volume_name': 'volume-c2813d7a-fd6f-4b79-ba79-15e60f333769', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddac2a5-18ee-45bc-9037-5828634f9cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddac2a5-18ee-45bc-9037-5828634f9cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5247168-6ba9-42df-ae50-e7ef400606ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:28 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Volume c2813d7a-fd6f-4b79-ba79-15e60f333769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2813d7a-fd6f-4b79-ba79-15e60f333769', 'volume_size': 1}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-527929059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2813d7a-fd6f-4b79-ba79-15e60f333769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e558e7e81c1428997029837ed9a6b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:28Z,use_quota=True,user_id='823c7d6baab04c43b8374cdb44c43412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Creating volume c2813d7a-fd6f-4b79-ba79-15e60f333769 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:38:28 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:28 devstack sudo[88596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769 1073741824
Sep 22 15:38:28 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:28 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:38:28 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:29 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769 1073741824" returned: 0 in 1.159s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:29 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.655s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:38:29 devstack sudo[88605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769
Sep 22 15:38:29 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 8 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:38:29 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769" returned: 0 in 0.399s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5247168-6ba9-42df-ae50-e7ef400606ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2813d7a-fd6f-4b79-ba79-15e60f333769', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1ab45a-fcdd-4f2f-92ca-a1b8e970a4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:29 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Volume volume-c2813d7a-fd6f-4b79-ba79-15e60f333769 (c2813d7a-fd6f-4b79-ba79-15e60f333769): created successfully
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1ab45a-fcdd-4f2f-92ca-a1b8e970a4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Flow 'volume_create_manager' (8bc2a329-de07-44ab-8342-75d8b25e219b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-73ab1bf4-1671-45e4-b121-659e6303e54e tempest-VolumesAdminNegativeTest-1749354410 None] Created volume successfully.
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Acquiring lock "cinder-585b9430-00a1-4a50-8d2e-46d845bf2707-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "cinder-585b9430-00a1-4a50-8d2e-46d845bf2707-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Acquiring lock "cinder-quobyte-585b9430-00a1-4a50-8d2e-46d845bf2707" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "cinder-quobyte-585b9430-00a1-4a50-8d2e-46d845bf2707" acquired by "delete_volume" :: waited 0.050s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[145f55d8-b2d3-4a8d-a75f-228031b68dbe]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:30 devstack sudo[88610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707
Sep 22 15:38:30 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Acquiring lock "cinder-c2813d7a-fd6f-4b79-ba79-15e60f333769-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Lock "cinder-c2813d7a-fd6f-4b79-ba79-15e60f333769-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Acquiring lock "cinder-quobyte-c2813d7a-fd6f-4b79-ba79-15e60f333769" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Lock "cinder-quobyte-c2813d7a-fd6f-4b79-ba79-15e60f333769" acquired by "delete_volume" :: waited 0.044s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7a74e-431f-4042-96b0-e231e4331ad3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:38:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:31 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707" returned: 0 in 0.757s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:31 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769
Sep 22 15:38:31 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:31 devstack sudo[88616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707
Sep 22 15:38:31 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:31 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-585b9430-00a1-4a50-8d2e-46d845bf2707" returned: 0 in 0.393s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "cinder-quobyte-585b9430-00a1-4a50-8d2e-46d845bf2707" released by "delete_volume" :: held 1.246s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Created reservations ['b905d5d9-3369-4d1f-bfc5-c3b78792ebc3', 'a315b278-940a-4da8-8fc9-552349701dc7', '2519a7c2-7c1a-4947-8a60-bab32d78045b', '2f619772-f3f7-48b5-ab91-b9174ac8641d'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:38:31 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769" returned: 0 in 0.893s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:31 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769
Sep 22 15:38:31 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:31 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:38:31 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:31 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2813d7a-fd6f-4b79-ba79-15e60f333769" returned: 0 in 0.357s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:32 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.289s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Lock "cinder-quobyte-c2813d7a-fd6f-4b79-ba79-15e60f333769" released by "delete_volume" :: held 1.326s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Deleted volume successfully.
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-894f34c4-2285-438e-9e55-4dc7b602ec2b tempest-AttachVolumeShelveTestJSON-1539838210 None] Lock "cinder-585b9430-00a1-4a50-8d2e-46d845bf2707-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Created reservations ['6f16d1c1-3c40-442e-8f04-c0304a6e3737', '9ad64807-b1ad-4896-b312-898248564548', '19bc412a-5b68-4102-b5d2-5af537ef12dc', 'df2a055c-27ba-45b7-a967-721e9ce5951b'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:32 devstack sudo[88654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:38:32 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:32 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.275s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:38:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Deleted volume successfully.
Sep 22 15:38:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1cb2faf5-a128-41cd-b89e-c7f60ea03776 tempest-VolumesAdminNegativeTest-1749354410 None] Lock "cinder-c2813d7a-fd6f-4b79-ba79-15e60f333769-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Flow 'volume_create_manager' (57f0c272-9505-4519-bb27-a188c35fa8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada0c620-5203-4f5e-b66c-613cd6e6bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada0c620-5203-4f5e-b66c-613cd6e6bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-832782674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01b4dfe-a6a5-40d2-a109-582752390eac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed2610e3de6459da76300659f8be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:42Z,use_quota=True,user_id='d2096c4bc75243a8acd99e2c8d00d6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49100cf3-440d-423f-b9e1-6d48883ad191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49100cf3-440d-423f-b9e1-6d48883ad191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c09b620-e02f-4ceb-9d32-7e36869ea398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c09b620-e02f-4ceb-9d32-7e36869ea398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd01b4dfe-a6a5-40d2-a109-582752390eac', 'volume_name': 'volume-d01b4dfe-a6a5-40d2-a109-582752390eac', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ae6f48-d782-4f0a-9a35-e67286461605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ae6f48-d782-4f0a-9a35-e67286461605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5aad12b-65be-47ca-bf4e-26a6b9aeeb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:42 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Volume d01b4dfe-a6a5-40d2-a109-582752390eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d01b4dfe-a6a5-40d2-a109-582752390eac', 'volume_size': 1}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-832782674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01b4dfe-a6a5-40d2-a109-582752390eac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed2610e3de6459da76300659f8be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:42Z,use_quota=True,user_id='d2096c4bc75243a8acd99e2c8d00d6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Creating volume d01b4dfe-a6a5-40d2-a109-582752390eac {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:38:42 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:42 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac 1073741824
Sep 22 15:38:42 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:42 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac 1073741824" returned: 0 in 0.537s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:42 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac
Sep 22 15:38:42 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:42 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:38:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5aad12b-65be-47ca-bf4e-26a6b9aeeb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d01b4dfe-a6a5-40d2-a109-582752390eac', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3648fa3e-4163-4a69-bc7a-0ea80b3cd555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Volume volume-d01b4dfe-a6a5-40d2-a109-582752390eac (d01b4dfe-a6a5-40d2-a109-582752390eac): created successfully
Sep 22 15:38:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3648fa3e-4163-4a69-bc7a-0ea80b3cd555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Flow 'volume_create_manager' (57f0c272-9505-4519-bb27-a188c35fa8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-efd2c61f-7cb1-400b-855f-eb7032f9939b tempest-VolumesTestJSON-143646200 None] Created volume successfully.
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Flow 'volume_create_manager' (2447723a-52c4-471d-8418-bc0cea3ce65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255c1114-6ddf-4cc8-8338-c0e8e5f32134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255c1114-6ddf-4cc8-8338-c0e8e5f32134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-954651239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe51289-37ed-49f6-a203-25396cd87d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4812f767f3e4e34ade738568d48ed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:44Z,use_quota=True,user_id='2c28e1e5f6d3445f9ea97d85a1716534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179de41f-d691-4a04-9d88-55843d88a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179de41f-d691-4a04-9d88-55843d88a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c814ac6-61a0-4cf5-b0e8-215d0db90220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c814ac6-61a0-4cf5-b0e8-215d0db90220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe51289-37ed-49f6-a203-25396cd87d6f', 'volume_name': 'volume-dbe51289-37ed-49f6-a203-25396cd87d6f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee63a1aa-5e8c-46a4-b83d-64041948912f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee63a1aa-5e8c-46a4-b83d-64041948912f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d281d8c7-a198-4912-9127-5c950257a206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:44 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Volume dbe51289-37ed-49f6-a203-25396cd87d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe51289-37ed-49f6-a203-25396cd87d6f', 'volume_size': 1}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-954651239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe51289-37ed-49f6-a203-25396cd87d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4812f767f3e4e34ade738568d48ed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:44Z,use_quota=True,user_id='2c28e1e5f6d3445f9ea97d85a1716534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Creating volume dbe51289-37ed-49f6-a203-25396cd87d6f {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:38:44 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:38:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:44 devstack sudo[88715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f 1073741824
Sep 22 15:38:44 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:45 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f 1073741824" returned: 0 in 0.626s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:38:45 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f
Sep 22 15:38:45 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Flow 'volume_create_manager' (52a91ed3-0620-4875-a752-4916164399f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540085fe-df8b-4a8d-98dd-b35c755ee195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540085fe-df8b-4a8d-98dd-b35c755ee195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1597387632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8e18bd-6ce2-4c76-8775-2b68712e823e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed2610e3de6459da76300659f8be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:45Z,use_quota=True,user_id='d2096c4bc75243a8acd99e2c8d00d6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61379df-bf03-4931-8ae4-eb212fa6e3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61379df-bf03-4931-8ae4-eb212fa6e3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f74c540-8399-42c3-8d9f-a8f591981f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f74c540-8399-42c3-8d9f-a8f591981f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8e18bd-6ce2-4c76-8775-2b68712e823e', 'volume_name': 'volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252b3f01-21a8-4c31-8b35-8b58ea7ced3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252b3f01-21a8-4c31-8b35-8b58ea7ced3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f456ac-f878-47c4-9508-7502e7ecc168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:45 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Volume 5e8e18bd-6ce2-4c76-8775-2b68712e823e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e', 'volume_size': 1}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:45 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f" returned: 0 in 0.299s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1597387632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8e18bd-6ce2-4c76-8775-2b68712e823e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed2610e3de6459da76300659f8be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:45Z,use_quota=True,user_id='d2096c4bc75243a8acd99e2c8d00d6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Creating volume 5e8e18bd-6ce2-4c76-8775-2b68712e823e {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:38:45 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d281d8c7-a198-4912-9127-5c950257a206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe51289-37ed-49f6-a203-25396cd87d6f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e66625-3a9b-4988-a16d-286177e4be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:45 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e 1073741824
Sep 22 15:38:45 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:45 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Volume volume-dbe51289-37ed-49f6-a203-25396cd87d6f (dbe51289-37ed-49f6-a203-25396cd87d6f): created successfully
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e66625-3a9b-4988-a16d-286177e4be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Flow 'volume_create_manager' (2447723a-52c4-471d-8418-bc0cea3ce65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d6f2633f-8df5-4a95-a4a4-12c00db57deb tempest-AttachVolumeNegativeTest-801672419 None] Created volume successfully.
Sep 22 15:38:45 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e 1073741824" returned: 0 in 0.477s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:45 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e
Sep 22 15:38:45 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:46 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e" returned: 0 in 0.263s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:38:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f456ac-f878-47c4-9508-7502e7ecc168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd30f6a2-5bb3-4835-9d95-60ef304924bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:46 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Volume volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e (5e8e18bd-6ce2-4c76-8775-2b68712e823e): created successfully
Sep 22 15:38:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd30f6a2-5bb3-4835-9d95-60ef304924bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Flow 'volume_create_manager' (52a91ed3-0620-4875-a752-4916164399f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b5ec6645-21e7-42d4-87aa-5c0247d38fc1 tempest-VolumesTestJSON-143646200 None] Created volume successfully.
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-ee613a03-5dbe-46d0-a494-25d5834e412b req-41992dd5-2a96-45bc-81e1-761a13dedbea tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-ee613a03-5dbe-46d0-a494-25d5834e412b req-41992dd5-2a96-45bc-81e1-761a13dedbea tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-ee613a03-5dbe-46d0-a494-25d5834e412b req-41992dd5-2a96-45bc-81e1-761a13dedbea tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Flow 'volume_create_manager' (18029602-4e31-4b6e-9279-cf06e9fcc011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24e1f79-60d7-49ef-9f33-16d83ec1cd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24e1f79-60d7-49ef-9f33-16d83ec1cd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-296074379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75425227-54c5-41de-9c76-c6eac975218b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed2610e3de6459da76300659f8be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:48Z,use_quota=True,user_id='d2096c4bc75243a8acd99e2c8d00d6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0a4a5e-7a89-4516-87e7-6851d663ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0a4a5e-7a89-4516-87e7-6851d663ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0571c4c4-4308-4b57-83a2-c0be64fdb955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0571c4c4-4308-4b57-83a2-c0be64fdb955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75425227-54c5-41de-9c76-c6eac975218b', 'volume_name': 'volume-75425227-54c5-41de-9c76-c6eac975218b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f6e1b6-4210-4fc9-959a-44fb0e64cd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f6e1b6-4210-4fc9-959a-44fb0e64cd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a6f0cb-a579-4615-8e6a-1ad59d750a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:47 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Volume 75425227-54c5-41de-9c76-c6eac975218b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75425227-54c5-41de-9c76-c6eac975218b', 'volume_size': 1}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-296074379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75425227-54c5-41de-9c76-c6eac975218b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed2610e3de6459da76300659f8be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:38:48Z,use_quota=True,user_id='d2096c4bc75243a8acd99e2c8d00d6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Creating volume 75425227-54c5-41de-9c76-c6eac975218b {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:38:47 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:38:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:48 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b 1073741824
Sep 22 15:38:48 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-ee613a03-5dbe-46d0-a494-25d5834e412b req-41992dd5-2a96-45bc-81e1-761a13dedbea tempest-AttachVolumeNegativeTest-801672419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-dbe51289-37ed-49f6-a203-25396cd87d6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba1c2430-2f3d-4776-a265-965da8b9137e', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:38:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-ee613a03-5dbe-46d0-a494-25d5834e412b req-41992dd5-2a96-45bc-81e1-761a13dedbea tempest-AttachVolumeNegativeTest-801672419 None] attachment_update completed successfully.
Sep 22 15:38:48 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b 1073741824" returned: 0 in 0.765s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:48 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b
Sep 22 15:38:48 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:49 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b" returned: 0 in 0.389s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:38:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a6f0cb-a579-4615-8e6a-1ad59d750a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75425227-54c5-41de-9c76-c6eac975218b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835e4c7c-a338-493e-bd4a-0cd0f4cc3c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:38:49 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Volume volume-75425227-54c5-41de-9c76-c6eac975218b (75425227-54c5-41de-9c76-c6eac975218b): created successfully
Sep 22 15:38:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835e4c7c-a338-493e-bd4a-0cd0f4cc3c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:38:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Flow 'volume_create_manager' (18029602-4e31-4b6e-9279-cf06e9fcc011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:38:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c3378c98-a29e-4123-8e77-099b757f3481 tempest-VolumesTestJSON-143646200 None] Created volume successfully.
Sep 22 15:38:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Acquiring lock "cinder-75425227-54c5-41de-9c76-c6eac975218b-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Lock "cinder-75425227-54c5-41de-9c76-c6eac975218b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Acquiring lock "cinder-quobyte-75425227-54c5-41de-9c76-c6eac975218b" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Lock "cinder-quobyte-75425227-54c5-41de-9c76-c6eac975218b" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a321824d-49fe-4a92-80e6-1ef20449338b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:38:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:51 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b
Sep 22 15:38:51 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:51 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b" returned: 0 in 0.495s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:51 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b
Sep 22 15:38:51 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:52 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75425227-54c5-41de-9c76-c6eac975218b" returned: 0 in 0.382s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Lock "cinder-quobyte-75425227-54c5-41de-9c76-c6eac975218b" released by "delete_volume" :: held 0.960s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Created reservations ['bdd4905e-ebf4-4b0a-b703-571625bc3f3f', '911ed013-d4dc-4d58-888d-5ceaacf9e76e', '5c6c7b02-f088-44f4-baac-92e895aca285', '9c036c19-4918-42af-916d-f2a7a67c7817'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:52 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:38:52 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:52 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.297s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:38:52 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Deleted volume successfully.
Sep 22 15:38:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-21d3fc37-1890-46eb-9ce7-844f49ab03ac tempest-VolumesTestJSON-143646200 None] Lock "cinder-75425227-54c5-41de-9c76-c6eac975218b-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Acquiring lock "cinder-5e8e18bd-6ce2-4c76-8775-2b68712e823e-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Lock "cinder-5e8e18bd-6ce2-4c76-8775-2b68712e823e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Acquiring lock "cinder-quobyte-5e8e18bd-6ce2-4c76-8775-2b68712e823e" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Lock "cinder-quobyte-5e8e18bd-6ce2-4c76-8775-2b68712e823e" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:53 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57aa7f0-19d2-4453-97b0-74a5d0ae450d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:38:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:53 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e
Sep 22 15:38:53 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:54 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e" returned: 0 in 0.354s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:54 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e
Sep 22 15:38:54 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:54 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5e8e18bd-6ce2-4c76-8775-2b68712e823e" returned: 0 in 0.284s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Lock "cinder-quobyte-5e8e18bd-6ce2-4c76-8775-2b68712e823e" released by "delete_volume" :: held 0.684s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Created reservations ['92bb4d54-d5a0-4ddd-b7d0-41d5f7cce01d', 'b28f967c-50ff-405f-9322-08b2512e3c2c', '5d92674e-cb28-41ff-9cd9-641a43b232de', 'b92d65dc-bca6-46d6-bf4c-8f3e38792f72'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:54 devstack sudo[89192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:38:54 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Acquiring lock "cinder-d01b4dfe-a6a5-40d2-a109-582752390eac-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Lock "cinder-d01b4dfe-a6a5-40d2-a109-582752390eac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:54 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.408s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:38:54 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Deleted volume successfully.
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Acquiring lock "cinder-quobyte-d01b4dfe-a6a5-40d2-a109-582752390eac" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Lock "cinder-quobyte-d01b4dfe-a6a5-40d2-a109-582752390eac" acquired by "delete_volume" :: waited 0.040s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e111135a-83c9-46ca-bd84-671cd66fa648 tempest-VolumesTestJSON-143646200 None] Lock "cinder-5e8e18bd-6ce2-4c76-8775-2b68712e823e-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d912737-008b-45e5-87c7-20db72f80b9e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:38:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:55 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac
Sep 22 15:38:55 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:55 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac" returned: 0 in 0.440s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:55 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac
Sep 22 15:38:55 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:55 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d01b4dfe-a6a5-40d2-a109-582752390eac" returned: 0 in 0.304s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Lock "cinder-quobyte-d01b4dfe-a6a5-40d2-a109-582752390eac" released by "delete_volume" :: held 0.810s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Created reservations ['91f2a5ac-7f1b-4d3e-a7cd-a85e4ff1b1ae', 'e4622e46-815c-475a-9edb-e065648114c9', '8fcea082-29bb-4a2a-86d4-83cedff7a773', '0c1995a3-641e-402f-bfc3-e421dd018537'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:38:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:38:55 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:38:55 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:38:56 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Sep 22 15:38:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.401s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:38:56 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:38:56 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Deleted volume successfully.
Sep 22 15:38:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9e56b2fd-7e32-47cf-b34f-3a13da227546 tempest-VolumesTestJSON-143646200 None] Lock "cinder-d01b4dfe-a6a5-40d2-a109-582752390eac-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:39:05 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=62,cinder:SELECT=46,cinder:INSERT=11,cinder:DELETE=4 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:39:06 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=47,cinder:INSERT=18,cinder:UPDATE=67,cinder:DELETE=7 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:39:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f469cbee-ef5e-4b66-87d5-34aff7f36cda tempest-GroupsTest-346726954 None] Group tempest-Group1-1736969325: creating
Sep 22 15:39:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f469cbee-ef5e-4b66-87d5-34aff7f36cda tempest-GroupsTest-346726954 None] Group tempest-Group1-1736969325: created successfully
Sep 22 15:39:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f469cbee-ef5e-4b66-87d5-34aff7f36cda tempest-GroupsTest-346726954 None] Create group completed successfully.
Sep 22 15:39:19 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-32f056f5-5285-4d26-939f-53e77c269c32 tempest-GroupsTest-346726954 None] Group tempest-Group2-1493342970: creating
Sep 22 15:39:19 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-32f056f5-5285-4d26-939f-53e77c269c32 tempest-GroupsTest-346726954 None] Group tempest-Group2-1493342970: created successfully
Sep 22 15:39:19 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-32f056f5-5285-4d26-939f-53e77c269c32 tempest-GroupsTest-346726954 None] Create group completed successfully.
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Flow 'volume_create_manager' (0b89fd69-8fbe-4107-a8d7-960f47975401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44304729-8807-4e92-bd0f-f65ac8f96d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44304729-8807-4e92-bd0f-f65ac8f96d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-785548120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8dba065b-3e84-4080-8a46-64f76b1abccb,host='devstack@QuobyteHD#QuobyteHD',id=32fa0cba-d0fe-4b10-bd3b-5023f16d38c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a859d899f544ec4bb7d3a2bdab159ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:22Z,use_quota=True,user_id='694f97e266044c0eabd02c6a69289ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eff1191f-353d-475b-93b0-c25510030974),volume_type_id=eff1191f-353d-475b-93b0-c25510030974)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcdd65-a797-4126-92be-af5c88549fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcdd65-a797-4126-92be-af5c88549fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321315be-58e1-41d4-b970-9147c1bb27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321315be-58e1-41d4-b970-9147c1bb27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32fa0cba-d0fe-4b10-bd3b-5023f16d38c7', 'volume_name': 'volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bb59d5-40c6-4b5f-afc8-a2765f8adc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bb59d5-40c6-4b5f-afc8-a2765f8adc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d8acaa-b62d-46b0-ad41-b72502faa313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:22 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Volume 32fa0cba-d0fe-4b10-bd3b-5023f16d38c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7', 'volume_size': 1}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8dba065b-3e84-4080-8a46-64f76b1abccb,created_at=2026-09-22T13:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-785548120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8dba065b-3e84-4080-8a46-64f76b1abccb,host='devstack@QuobyteHD#QuobyteHD',id=32fa0cba-d0fe-4b10-bd3b-5023f16d38c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a859d899f544ec4bb7d3a2bdab159ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:22Z,use_quota=True,user_id='694f97e266044c0eabd02c6a69289ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eff1191f-353d-475b-93b0-c25510030974),volume_type_id=eff1191f-353d-475b-93b0-c25510030974)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Creating volume 32fa0cba-d0fe-4b10-bd3b-5023f16d38c7 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:39:22 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:22 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7 1073741824
Sep 22 15:39:22 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:22 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7 1073741824" returned: 0 in 0.510s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:22 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7
Sep 22 15:39:22 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:23 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7" returned: 0 in 0.355s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:39:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d8acaa-b62d-46b0-ad41-b72502faa313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0221b777-706c-4327-9d8e-54f508271975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:23 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Volume volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7 (32fa0cba-d0fe-4b10-bd3b-5023f16d38c7): created successfully
Sep 22 15:39:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0221b777-706c-4327-9d8e-54f508271975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Flow 'volume_create_manager' (0b89fd69-8fbe-4107-a8d7-960f47975401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ed286028-b533-471d-bb3d-bd80e9ca7bf1 tempest-GroupsTest-346726954 None] Created volume successfully.
Sep 22 15:39:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Acquiring lock "cinder-quobyte-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:39:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Lock "cinder-quobyte-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7" acquired by "delete_volume" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:39:25 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e3061b-2f2e-4105-97d2-beaadfdc4ca0]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:39:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:25 devstack sudo[89490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7
Sep 22 15:39:25 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:26 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7" returned: 0 in 0.553s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:26 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7
Sep 22 15:39:26 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:26 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7" returned: 0 in 0.425s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Lock "cinder-quobyte-32fa0cba-d0fe-4b10-bd3b-5023f16d38c7" released by "delete_volume" :: held 1.070s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Created reservations ['ff663828-b3d9-46a3-9094-17f2c0eba90f'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:39:26 devstack cinder-volume[85987]: WARNING cinder.quota [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1187004494 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1187004494, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:39:26 devstack cinder-volume[85987]: WARNING cinder.quota [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1187004494 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1187004494, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Created reservations ['cabef688-38ab-445a-9b3e-ae77e1e9c952', '8288b348-f0a3-4ecf-a6a5-ee4010762fa1', 'e4dfa6cc-e6ad-46d7-8a3e-77b53eb9fd34', 'dfb80729-e7d9-4121-b29d-9c162fa34722'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:26 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:39:26 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:27 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.275s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:27 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:39:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8088a278-8104-4ce9-b7ed-bd1eb7f0bf9e tempest-GroupsTest-346726954 None] Delete group completed successfully.
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] Created reservations ['4db23701-78e0-49d5-b3e9-6287abfe468a'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:28 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:39:28 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:28 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.407s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:39:28 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b36a74f1-df87-4e7a-a98d-d90b6c77184a tempest-GroupsTest-346726954 None] Delete group completed successfully.
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:28 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:39:28 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:29 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.440s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:39:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bf28652d-4ece-46cf-8d78-f98a91734cec tempest-GroupsTest-346726954 None] Group tempest-GroupsTest-Group-1613390271: creating
Sep 22 15:39:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bf28652d-4ece-46cf-8d78-f98a91734cec tempest-GroupsTest-346726954 None] Group tempest-GroupsTest-Group-1613390271: created successfully
Sep 22 15:39:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bf28652d-4ece-46cf-8d78-f98a91734cec tempest-GroupsTest-346726954 None] Create group completed successfully.
Sep 22 15:39:31 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Flow 'volume_create_manager' (c5d19de6-1e07-44c3-a0ef-3f31205cd0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95acb5a5-373b-4ec2-83fa-5f78f926f53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Flow 'volume_create_manager' (72490f25-d04f-4ea6-b18e-c417c7928588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c8b86e-71d8-4d6d-9599-a5781689b027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95acb5a5-373b-4ec2-83fa-5f78f926f53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-713828741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce4ee099-bd59-4f0d-9058-a7dd8ffbf94c,host='devstack@QuobyteHD#QuobyteHD',id=63adba80-43b0-4155-b6fd-a997d7dbda2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a859d899f544ec4bb7d3a2bdab159ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:32Z,use_quota=True,user_id='694f97e266044c0eabd02c6a69289ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f06e6c7-6e8b-4e7c-a156-66671e85339c),volume_type_id=8f06e6c7-6e8b-4e7c-a156-66671e85339c)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b9a57d-fcfa-406c-bb3e-1f632b8f31b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b9a57d-fcfa-406c-bb3e-1f632b8f31b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8869b303-c5cc-471c-bfe0-95e44801279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8869b303-c5cc-471c-bfe0-95e44801279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63adba80-43b0-4155-b6fd-a997d7dbda2e', 'volume_name': 'volume-63adba80-43b0-4155-b6fd-a997d7dbda2e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ce4e4d-9c6f-4401-98fe-7f6ec7f8344f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ce4e4d-9c6f-4401-98fe-7f6ec7f8344f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6bba13-40d5-4b96-a49e-ee19c0221efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Volume 63adba80-43b0-4155-b6fd-a997d7dbda2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63adba80-43b0-4155-b6fd-a997d7dbda2e', 'volume_size': 1}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ce4ee099-bd59-4f0d-9058-a7dd8ffbf94c,created_at=2026-09-22T13:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-713828741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce4ee099-bd59-4f0d-9058-a7dd8ffbf94c,host='devstack@QuobyteHD#QuobyteHD',id=63adba80-43b0-4155-b6fd-a997d7dbda2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a859d899f544ec4bb7d3a2bdab159ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:32Z,use_quota=True,user_id='694f97e266044c0eabd02c6a69289ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f06e6c7-6e8b-4e7c-a156-66671e85339c),volume_type_id=8f06e6c7-6e8b-4e7c-a156-66671e85339c)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Creating volume 63adba80-43b0-4155-b6fd-a997d7dbda2e {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:39:32 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c8b86e-71d8-4d6d-9599-a5781689b027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-872125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ddeed3e-57eb-4c4a-8710-9bf877924ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39367aeefa814fa690b9915b87154c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:32Z,use_quota=True,user_id='840556f704e54ea3a7e9a5584db3afd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:32 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e 1073741824
Sep 22 15:39:32 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca0caf8-bc28-4012-b13a-39b347b72aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca0caf8-bc28-4012-b13a-39b347b72aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4240f001-5069-43e5-8df2-daa70a0f2171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4240f001-5069-43e5-8df2-daa70a0f2171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ddeed3e-57eb-4c4a-8710-9bf877924ed8', 'volume_name': 'volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facc41e5-ed98-4715-ad59-24d182674cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facc41e5-ed98-4715-ad59-24d182674cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec7687a-1c9c-4704-b0ba-e1139645ff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:32 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Volume 0ddeed3e-57eb-4c4a-8710-9bf877924ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8', 'volume_size': 1}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:32 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e 1073741824" returned: 0 in 0.434s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:32 devstack sudo[89624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e
Sep 22 15:39:32 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:32 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-872125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ddeed3e-57eb-4c4a-8710-9bf877924ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39367aeefa814fa690b9915b87154c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:32Z,use_quota=True,user_id='840556f704e54ea3a7e9a5584db3afd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Creating volume 0ddeed3e-57eb-4c4a-8710-9bf877924ed8 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:39:32 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6bba13-40d5-4b96-a49e-ee19c0221efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63adba80-43b0-4155-b6fd-a997d7dbda2e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:32 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8 1073741824
Sep 22 15:39:32 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ae56fb-64ec-40ae-9de9-03f59821e2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:33 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Volume volume-63adba80-43b0-4155-b6fd-a997d7dbda2e (63adba80-43b0-4155-b6fd-a997d7dbda2e): created successfully
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ae56fb-64ec-40ae-9de9-03f59821e2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Flow 'volume_create_manager' (c5d19de6-1e07-44c3-a0ef-3f31205cd0e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:33 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2d51e500-9a34-48b1-bd64-b2829c53eae0 tempest-GroupsTest-346726954 None] Created volume successfully.
Sep 22 15:39:33 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8 1073741824" returned: 0 in 0.504s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:33 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8
Sep 22 15:39:33 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:33 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8" returned: 0 in 0.270s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec7687a-1c9c-4704-b0ba-e1139645ff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b936030-8415-4119-a3a9-2676d1568370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:33 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Volume volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8 (0ddeed3e-57eb-4c4a-8710-9bf877924ed8): created successfully
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b936030-8415-4119-a3a9-2676d1568370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Flow 'volume_create_manager' (72490f25-d04f-4ea6-b18e-c417c7928588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:33 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-53608c8f-86b7-4573-a8b3-4ea56e1cd04a tempest-DeleteServersTestJSON-919303166 None] Created volume successfully.
Sep 22 15:39:34 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:39:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Flow 'volume_create_manager' (011990f4-1af1-4252-a417-a0178e51acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223815f5-db4f-446d-96c4-40acdbb32b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223815f5-db4f-446d-96c4-40acdbb32b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1587066833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce4ee099-bd59-4f0d-9058-a7dd8ffbf94c,host='devstack@QuobyteHD#QuobyteHD',id=cd0396db-a083-40d6-84e0-294844f7add9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a859d899f544ec4bb7d3a2bdab159ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:35Z,use_quota=True,user_id='694f97e266044c0eabd02c6a69289ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f06e6c7-6e8b-4e7c-a156-66671e85339c),volume_type_id=8f06e6c7-6e8b-4e7c-a156-66671e85339c)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7450846-79c0-45a8-8362-5c396697e36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7450846-79c0-45a8-8362-5c396697e36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bd687a-bd08-483e-8b82-7814584da2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bd687a-bd08-483e-8b82-7814584da2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0396db-a083-40d6-84e0-294844f7add9', 'volume_name': 'volume-cd0396db-a083-40d6-84e0-294844f7add9', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a46b5e5-f2e2-4eeb-af9f-ced36566759d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a46b5e5-f2e2-4eeb-af9f-ced36566759d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64087310-bb50-40c7-b313-36107c377686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:35 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Volume cd0396db-a083-40d6-84e0-294844f7add9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0396db-a083-40d6-84e0-294844f7add9', 'volume_size': 1}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ce4ee099-bd59-4f0d-9058-a7dd8ffbf94c,created_at=2026-09-22T13:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1587066833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce4ee099-bd59-4f0d-9058-a7dd8ffbf94c,host='devstack@QuobyteHD#QuobyteHD',id=cd0396db-a083-40d6-84e0-294844f7add9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a859d899f544ec4bb7d3a2bdab159ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:35Z,use_quota=True,user_id='694f97e266044c0eabd02c6a69289ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f06e6c7-6e8b-4e7c-a156-66671e85339c),volume_type_id=8f06e6c7-6e8b-4e7c-a156-66671e85339c)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Creating volume cd0396db-a083-40d6-84e0-294844f7add9 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:39:35 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-62caac42-863a-4aad-90f4-ec95d69f82fc req-317c1d77-ad03-48cb-bb9f-4ee4bcc5cb30 tempest-DeleteServersTestJSON-919303166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:35 devstack sudo[89653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9 1073741824
Sep 22 15:39:35 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:35 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9 1073741824" returned: 0 in 0.602s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:35 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9
Sep 22 15:39:35 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:36 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-62caac42-863a-4aad-90f4-ec95d69f82fc req-317c1d77-ad03-48cb-bb9f-4ee4bcc5cb30 tempest-DeleteServersTestJSON-919303166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.005s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64087310-bb50-40c7-b313-36107c377686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0396db-a083-40d6-84e0-294844f7add9', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe96977b-f841-4f59-b3d5-02aaad62dc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-62caac42-863a-4aad-90f4-ec95d69f82fc req-317c1d77-ad03-48cb-bb9f-4ee4bcc5cb30 tempest-DeleteServersTestJSON-919303166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.143s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Volume volume-cd0396db-a083-40d6-84e0-294844f7add9 (cd0396db-a083-40d6-84e0-294844f7add9): created successfully
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe96977b-f841-4f59-b3d5-02aaad62dc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Flow 'volume_create_manager' (011990f4-1af1-4252-a417-a0178e51acbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ef6a2e52-99f8-4a0c-bbd8-c0278d888e71 tempest-GroupsTest-346726954 None] Created volume successfully.
Sep 22 15:39:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-62caac42-863a-4aad-90f4-ec95d69f82fc req-317c1d77-ad03-48cb-bb9f-4ee4bcc5cb30 tempest-DeleteServersTestJSON-919303166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f7a23b6-ee96-444b-83d0-7d06c29b2db8', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:39:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-62caac42-863a-4aad-90f4-ec95d69f82fc req-317c1d77-ad03-48cb-bb9f-4ee4bcc5cb30 tempest-DeleteServersTestJSON-919303166 None] attachment_update completed successfully.
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Flow 'volume_create_manager' (429b35d0-7950-46e2-a831-51f4978276e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234f785a-58f0-40df-b771-bb6a08493fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234f785a-58f0-40df-b771-bb6a08493fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-997491228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36e75eb0ce04ac2ae8d182f3db47ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:38Z,use_quota=True,user_id='e75d8b94358a41f69b2113dc1343def9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1a58f7-20ed-40e3-aaea-343fd99f9da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1a58f7-20ed-40e3-aaea-343fd99f9da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a392e-ed81-47ee-8ec7-b94ac36aee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a392e-ed81-47ee-8ec7-b94ac36aee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a', 'volume_name': 'volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ff2f9d-0e5d-4d74-8078-d57fa66dd639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ff2f9d-0e5d-4d74-8078-d57fa66dd639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f5c574-e2c1-4866-85e4-d015b1c0ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Volume ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a', 'volume_size': 1}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-997491228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36e75eb0ce04ac2ae8d182f3db47ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:39:38Z,use_quota=True,user_id='e75d8b94358a41f69b2113dc1343def9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Creating volume ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:39:38 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:39:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:38 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a 1073741824
Sep 22 15:39:38 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a6b5318a-d8e0-474b-8993-adc27d150255 tempest-GroupsTest-346726954 None] Update group completed successfully.
Sep 22 15:39:39 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a 1073741824" returned: 0 in 1.161s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:39 devstack sudo[89726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a
Sep 22 15:39:39 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:40 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a" returned: 0 in 0.579s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:39:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f5c574-e2c1-4866-85e4-d015b1c0ec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2501dcf5-bf22-4ad6-90e7-64b73ee77089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:39:40 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Volume volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a (ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a): created successfully
Sep 22 15:39:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2501dcf5-bf22-4ad6-90e7-64b73ee77089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:39:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Flow 'volume_create_manager' (429b35d0-7950-46e2-a831-51f4978276e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:39:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-065e2bae-e232-4c56-9542-9a19db5f30b3 tempest-GroupsTest-346726954 None] Update group completed successfully.
Sep 22 15:39:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-66157a35-95bb-4b74-a7e7-c4a5d449c43d tempest-ServerActionsTestOtherA-1626109131 None] Created volume successfully.
Sep 22 15:39:41 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-7d9dbb70-4189-4632-81ca-69ef07969ccb req-76805d34-8978-4fb8-befc-271b34e3fbc4 tempest-DeleteServersTestJSON-919303166 None] Terminate volume connection completed successfully.
Sep 22 15:39:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-7d9dbb70-4189-4632-81ca-69ef07969ccb req-76805d34-8978-4fb8-befc-271b34e3fbc4 tempest-DeleteServersTestJSON-919303166 None] Deleting attachment 4f7a23b6-ee96-444b-83d0-7d06c29b2db8. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Acquiring lock "cinder-quobyte-63adba80-43b0-4155-b6fd-a997d7dbda2e" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Lock "cinder-quobyte-63adba80-43b0-4155-b6fd-a997d7dbda2e" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bbce30-91e2-4764-8fee-86cd922395e8]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:42 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e
Sep 22 15:39:42 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:42 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e" returned: 0 in 0.500s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:42 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e
Sep 22 15:39:42 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-172c679d-d861-4307-97c8-6ed3c7cd515d req-1e9ef878-197f-42f0-a02c-4e39236bca70 tempest-AttachVolumeNegativeTest-801672419 None] Terminate volume connection completed successfully.
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-172c679d-d861-4307-97c8-6ed3c7cd515d req-1e9ef878-197f-42f0-a02c-4e39236bca70 tempest-AttachVolumeNegativeTest-801672419 None] Deleting attachment ba1c2430-2f3d-4776-a265-965da8b9137e. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:39:42 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-63adba80-43b0-4155-b6fd-a997d7dbda2e" returned: 0 in 0.361s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Lock "cinder-quobyte-63adba80-43b0-4155-b6fd-a997d7dbda2e" released by "delete_volume" :: held 0.928s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:39:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Acquiring lock "cinder-quobyte-cd0396db-a083-40d6-84e0-294844f7add9" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Acquiring lock "cinder-0ddeed3e-57eb-4c4a-8710-9bf877924ed8-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Lock "cinder-quobyte-cd0396db-a083-40d6-84e0-294844f7add9" acquired by "delete_volume" :: waited 0.035s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Lock "cinder-0ddeed3e-57eb-4c4a-8710-9bf877924ed8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca143ecd-aa7e-42e7-9648-8c6f3d955bad]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Acquiring lock "cinder-quobyte-0ddeed3e-57eb-4c4a-8710-9bf877924ed8" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Lock "cinder-quobyte-0ddeed3e-57eb-4c4a-8710-9bf877924ed8" acquired by "delete_volume" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a69349b-98d3-484f-a582-eacf2d86013b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:43 devstack sudo[89779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9
Sep 22 15:39:43 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:43 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8
Sep 22 15:39:43 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:43 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9" returned: 0 in 0.543s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:43 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9
Sep 22 15:39:43 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:43 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8" returned: 0 in 0.460s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:43 devstack sudo[89793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8
Sep 22 15:39:43 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:44 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd0396db-a083-40d6-84e0-294844f7add9" returned: 0 in 0.392s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Lock "cinder-quobyte-cd0396db-a083-40d6-84e0-294844f7add9" released by "delete_volume" :: held 1.013s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:39:44 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0ddeed3e-57eb-4c4a-8710-9bf877924ed8" returned: 0 in 0.408s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Lock "cinder-quobyte-0ddeed3e-57eb-4c4a-8710-9bf877924ed8" released by "delete_volume" :: held 0.947s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Created reservations ['d4479921-9baa-4656-ae8a-39ea13c4fc9b'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Created reservations ['7ef75884-b1bb-49c5-96d8-5f3ec07b68d0', '5cc91f62-a0de-4c09-b547-3af7a7f6eb66', 'd33a15b5-d504-4c49-9e81-275f2f105a32', '14f4e85c-aec5-406e-8de1-46f6eb96fdaa'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:39:44 devstack cinder-volume[85987]: WARNING cinder.quota [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-702095920 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-702095920, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:39:44 devstack cinder-volume[85987]: WARNING cinder.quota [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-702095920 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-702095920, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Created reservations ['85fd3092-0bd5-4a34-94b9-46f35b74a5ee', 'c67d4424-358d-4921-b0cb-85804d8227b9', '38e5b1a7-743d-42d7-9ea2-dedccd717fca', '53a55f0f-0470-4794-b58e-c2b55070122e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:44 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:39:44 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Created reservations ['85b152ad-f133-4893-9644-1028ba899268', '54f4d65d-e2db-46ce-ae77-98d306921d0e', '5083eb48-7899-4a7e-b7b8-320d8d693a13', 'b24d2785-7d83-4d1c-8a72-ded8fdacda96'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:44 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:39:44 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:45 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.489s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:45 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:39:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Deleted volume successfully.
Sep 22 15:39:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6a74532a-6a40-44d6-b545-af898d0f7a09 tempest-DeleteServersTestJSON-919303166 None] Lock "cinder-0ddeed3e-57eb-4c4a-8710-9bf877924ed8-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:39:45 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.492s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:45 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:39:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4cbe7e59-8a4a-4e49-b4ba-fdf316fc8cc0 tempest-GroupsTest-346726954 None] Delete group completed successfully.
Sep 22 15:39:54 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=49,cinder:UPDATE=66,cinder:INSERT=12 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:39:55 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=69,cinder:UPDATE=57,cinder:INSERT=12,cinder:DELETE=6 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:39:56 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-481617fb-1a49-4d81-9d06-9015ade292e6 tempest-GroupsV320Test-1290567675 None] Group tempest-GroupsV320Test-Group-942781877: creating
Sep 22 15:39:57 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-481617fb-1a49-4d81-9d06-9015ade292e6 tempest-GroupsV320Test-1290567675 None] Group tempest-GroupsV320Test-Group-942781877: created successfully
Sep 22 15:39:57 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-481617fb-1a49-4d81-9d06-9015ade292e6 tempest-GroupsV320Test-1290567675 None] Create group completed successfully.
Sep 22 15:39:59 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] Created reservations ['07193560-f951-40ce-9a72-cc8dd1e02876'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:39:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:39:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:39:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:39:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:39:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:39:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:39:59 devstack sudo[89920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:39:59 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:39:59 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root
Sep 22 15:39:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.438s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:39:59 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:39:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-899d42ee-7858-447b-abac-62d4b2cea569 tempest-GroupsV320Test-1290567675 None] Delete group completed successfully.
Sep 22 15:40:09 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:40:09 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Flow 'volume_create_manager' (6e187c13-053c-4ce6-b1f5-73f89d49597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2cb6b1-4f8f-4358-88da-962b5478eaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2cb6b1-4f8f-4358-88da-962b5478eaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-152539196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751a0d42-8e0a-492a-9ab5-15621f34ff95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35597e26494c41568ac646bdf06d8891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:12Z,use_quota=True,user_id='91d10bf3f6fe4cb6b8107fd9f3910401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4354287b-2704-4636-9d1c-56fd95cc7c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4354287b-2704-4636-9d1c-56fd95cc7c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efce402b-235a-4443-84b2-ec18f521bbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efce402b-235a-4443-84b2-ec18f521bbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751a0d42-8e0a-492a-9ab5-15621f34ff95', 'volume_name': 'volume-751a0d42-8e0a-492a-9ab5-15621f34ff95', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3038586-d987-4bd8-8ea8-74bae1b0b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3038586-d987-4bd8-8ea8-74bae1b0b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367cd1a2-4316-4311-ad10-e66d0c27f208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:12 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Volume 751a0d42-8e0a-492a-9ab5-15621f34ff95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751a0d42-8e0a-492a-9ab5-15621f34ff95', 'volume_size': 1}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-152539196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751a0d42-8e0a-492a-9ab5-15621f34ff95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35597e26494c41568ac646bdf06d8891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:12Z,use_quota=True,user_id='91d10bf3f6fe4cb6b8107fd9f3910401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Creating volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:40:12 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:40:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:12 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 1073741824
Sep 22 15:40:12 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:13 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 1073741824" returned: 0 in 0.612s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:13 devstack sudo[90081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95
Sep 22 15:40:13 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:13 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:40:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367cd1a2-4316-4311-ad10-e66d0c27f208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751a0d42-8e0a-492a-9ab5-15621f34ff95', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b9c34a-b700-4f7f-9782-96c02c19854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Volume volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 (751a0d42-8e0a-492a-9ab5-15621f34ff95): created successfully
Sep 22 15:40:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b9c34a-b700-4f7f-9782-96c02c19854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Flow 'volume_create_manager' (6e187c13-053c-4ce6-b1f5-73f89d49597d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:40:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8eb2cecc-9af8-4be3-86c8-2f52bd0b74cd tempest-SnapshotsActionsTest-769961830 None] Created volume successfully.
Sep 22 15:40:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Creating offline snapshot 452d78d8-86ed-4956-b19b-050b3804a321 of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:40:14 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[071b609d-e179-4f88-a6d5-6f52900a77aa]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:15 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95
Sep 22 15:40:15 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:15 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95" returned: 0 in 0.448s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:15 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 1G
Sep 22 15:40:15 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:15 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 1G" returned: 0 in 0.509s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:15 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:15 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:16 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.645s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:16 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 is being set with open permissions: ugo+rw
Sep 22 15:40:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:16 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:16 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:17 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.495s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:17 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.info
Sep 22 15:40:17 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:17 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.info" returned: 0 in 0.433s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:17 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.info is being set with open permissions: ugo+rw
Sep 22 15:40:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:17 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.info
Sep 22 15:40:17 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:17 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.info" returned: 0 in 0.333s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-895cbb30-5201-4cec-9f25-58098c78f784 tempest-SnapshotsActionsTest-769961830 None] Create snapshot completed successfully
Sep 22 15:40:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-19fa64f3-1bb4-4798-8e50-5da30b909f5d req-c4a82d7f-e7f6-4125-b3e9-c56fad009d5e tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-19fa64f3-1bb4-4798-8e50-5da30b909f5d req-c4a82d7f-e7f6-4125-b3e9-c56fad009d5e tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-19fa64f3-1bb4-4798-8e50-5da30b909f5d req-c4a82d7f-e7f6-4125-b3e9-c56fad009d5e tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-19fa64f3-1bb4-4798-8e50-5da30b909f5d req-c4a82d7f-e7f6-4125-b3e9-c56fad009d5e tempest-ServerActionsTestOtherA-1626109131 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ceefd19-fd7e-41cc-9583-3df1b4dd81f1', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:40:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-19fa64f3-1bb4-4798-8e50-5da30b909f5d req-c4a82d7f-e7f6-4125-b3e9-c56fad009d5e tempest-ServerActionsTestOtherA-1626109131 None] attachment_update completed successfully.
Sep 22 15:40:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Creating offline snapshot d6efdcb3-f19e-4627-a811-9e88dffb5255 of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:40:19 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7effbfd4-d729-47b9-8f12-cff220d90a5e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:19 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:19 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:19 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.456s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:19 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 1G
Sep 22 15:40:19 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:20 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 1G" returned: 0 in 0.850s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:20 devstack sudo[90649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255
Sep 22 15:40:20 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:20 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255" returned: 0 in 0.556s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:20 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 is being set with open permissions: ugo+rw
Sep 22 15:40:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:21 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255
Sep 22 15:40:21 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:21 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255" returned: 0 in 0.336s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ee85d8d9-f360-434f-a963-9e5095c6be01 tempest-SnapshotsActionsTest-769961830 None] Create snapshot completed successfully
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-d6efdcb3-f19e-4627-a811-9e88dffb5255-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-d6efdcb3-f19e-4627-a811-9e88dffb5255-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-quobyte-d6efdcb3-f19e-4627-a811-9e88dffb5255" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-d6efdcb3-f19e-4627-a811-9e88dffb5255" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Deleting offline snapshot d6efdcb3-f19e-4627-a811-9e88dffb5255 of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] snapshot_file for this snap is: volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdacb0d3-04e9-4093-81ec-3c8477b48ed4]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:22 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255
Sep 22 15:40:22 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:22 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255" returned: 0 in 0.540s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-88b06cb3-582e-4d71-9f3a-552dd7d04acf req-f2a58761-f25c-4441-912e-c3116ad710b5 tempest-ServerActionsTestOtherA-1626109131 None] Terminate volume connection completed successfully.
Sep 22 15:40:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-88b06cb3-582e-4d71-9f3a-552dd7d04acf req-f2a58761-f25c-4441-912e-c3116ad710b5 tempest-ServerActionsTestOtherA-1626109131 None] Deleting attachment 1ceefd19-fd7e-41cc-9583-3df1b4dd81f1. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:40:23 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[86974372-3550-4bfa-9634-9c243d1b7bf6]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:23 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:23 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:23 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.902s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:24 devstack sudo[90742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255
Sep 22 15:40:24 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-88b06cb3-582e-4d71-9f3a-552dd7d04acf req-f4a64814-b6f3-4d62-8c73-d158092b086f tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-88b06cb3-582e-4d71-9f3a-552dd7d04acf req-f4a64814-b6f3-4d62-8c73-d158092b086f tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-88b06cb3-582e-4d71-9f3a-552dd7d04acf req-f4a64814-b6f3-4d62-8c73-d158092b086f tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:24 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255" returned: 0 in 0.666s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:24 devstack sudo[90760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255
Sep 22 15:40:24 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-88b06cb3-582e-4d71-9f3a-552dd7d04acf req-f4a64814-b6f3-4d62-8c73-d158092b086f tempest-ServerActionsTestOtherA-1626109131 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4dc9e4c-3020-4923-bdd5-8699aad27b36', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:40:24 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-88b06cb3-582e-4d71-9f3a-552dd7d04acf req-f4a64814-b6f3-4d62-8c73-d158092b086f tempest-ServerActionsTestOtherA-1626109131 None] attachment_update completed successfully.
Sep 22 15:40:25 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.d6efdcb3-f19e-4627-a811-9e88dffb5255" returned: 0 in 0.679s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-d6efdcb3-f19e-4627-a811-9e88dffb5255" released by "_delete_snapshot" :: held 2.997s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" released by "delete_snapshot" :: held 3.036s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:25 devstack cinder-volume[85987]: WARNING cinder.quota [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:40:25 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Created reservations ['259cd10d-7fa2-4c30-b383-d57e1124ec8c', '1882244b-49bd-482a-a07f-6e64a0208936', '209666d5-d574-4fb3-adab-d83edfccdd0c', '56960300-f5ac-4c3c-a12d-7c19b76e0666'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:40:25 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Delete snapshot completed successfully.
Sep 22 15:40:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6d7c9f70-5c28-440d-8bd0-94dd6e71e98b tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-d6efdcb3-f19e-4627-a811-9e88dffb5255-delete_snapshot" released by "delete_snapshot" :: held 3.457s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Creating offline snapshot cd10187a-daa1-4f1e-b55a-8c47e5646cab of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c793e10-28a6-400e-9a7c-83241039c0db]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:28 devstack sudo[90913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:28 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:28 devstack sudo[91246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:40:28 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:28 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.960s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:29 devstack sudo[91261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab 1G
Sep 22 15:40:29 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:29 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.832s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:40:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:40:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 8 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:40:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:40:29 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab 1G" returned: 0 in 0.893s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:29 devstack sudo[91271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab
Sep 22 15:40:29 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:30 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab" returned: 0 in 0.469s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:30 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab is being set with open permissions: ugo+rw
Sep 22 15:40:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:30 devstack sudo[91276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab
Sep 22 15:40:30 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:30 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab" returned: 0 in 0.653s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.321s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:31 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-74c0f972-c446-4b6c-8d8a-828759f8fa6d tempest-SnapshotsActionsTest-769961830 None] Create snapshot completed successfully
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Flow 'volume_create_manager' (cdda99fc-22d0-4521-9e46-786ff20a7303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d3299b-4aa6-44ad-9828-9d85f69b82dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-cd10187a-daa1-4f1e-b55a-8c47e5646cab-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d3299b-4aa6-44ad-9828-9d85f69b82dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-921909307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c3db9a-1817-4c26-acec-6369a0c75573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4812f767f3e4e34ade738568d48ed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:32Z,use_quota=True,user_id='2c28e1e5f6d3445f9ea97d85a1716534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e736ec-0870-45b5-a89d-ee98f4782a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e736ec-0870-45b5-a89d-ee98f4782a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bb9250-b4c7-46cf-a9e3-0d09b7ce86f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bb9250-b4c7-46cf-a9e3-0d09b7ce86f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c3db9a-1817-4c26-acec-6369a0c75573', 'volume_name': 'volume-e7c3db9a-1817-4c26-acec-6369a0c75573', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d9c583-a527-4f65-82ca-2c307144e0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d9c583-a527-4f65-82ca-2c307144e0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6ad6e9-5bd3-438d-937c-de12ef9b5e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:33 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Volume e7c3db9a-1817-4c26-acec-6369a0c75573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c3db9a-1817-4c26-acec-6369a0c75573', 'volume_size': 1}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-921909307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c3db9a-1817-4c26-acec-6369a0c75573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4812f767f3e4e34ade738568d48ed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:32Z,use_quota=True,user_id='2c28e1e5f6d3445f9ea97d85a1716534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Creating volume e7c3db9a-1817-4c26-acec-6369a0c75573 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:40:33 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-cd10187a-daa1-4f1e-b55a-8c47e5646cab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.414s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:33 devstack sudo[91301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573 1073741824
Sep 22 15:40:33 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-quobyte-cd10187a-daa1-4f1e-b55a-8c47e5646cab" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-cd10187a-daa1-4f1e-b55a-8c47e5646cab" acquired by "_delete_snapshot" :: waited 0.083s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Deleting offline snapshot cd10187a-daa1-4f1e-b55a-8c47e5646cab of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] snapshot_file for this snap is: volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c038707-958c-432a-aeea-6edb8848c9e7]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:33 devstack sudo[91313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab
Sep 22 15:40:33 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:34 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab" returned: 0 in 1.004s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:34 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573 1073741824" returned: 0 in 1.423s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:34 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc03a41-043c-43d4-b536-364a88d23585]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:34 devstack sudo[91353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:34 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:34 devstack sudo[91354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573
Sep 22 15:40:34 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:35 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573" returned: 0 in 0.535s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6ad6e9-5bd3-438d-937c-de12ef9b5e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c3db9a-1817-4c26-acec-6369a0c75573', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeadb13b-4241-41aa-94bd-54fd197d1ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:35 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Volume volume-e7c3db9a-1817-4c26-acec-6369a0c75573 (e7c3db9a-1817-4c26-acec-6369a0c75573): created successfully
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeadb13b-4241-41aa-94bd-54fd197d1ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Flow 'volume_create_manager' (cdda99fc-22d0-4521-9e46-786ff20a7303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:40:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9a1e4464-884b-4f62-9c47-8fe0050ccbda tempest-AttachVolumeNegativeTest-801672419 None] Created volume successfully.
Sep 22 15:40:35 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.876s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:35 devstack sudo[91363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab
Sep 22 15:40:35 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:36 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab" returned: 0 in 0.786s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:36 devstack sudo[91389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab
Sep 22 15:40:36 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:36 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.cd10187a-daa1-4f1e-b55a-8c47e5646cab" returned: 0 in 0.544s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-cd10187a-daa1-4f1e-b55a-8c47e5646cab" released by "_delete_snapshot" :: held 3.638s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" released by "delete_snapshot" :: held 3.745s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:37 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Created reservations ['92519b57-557c-4674-8fff-a1f0f9ab0f38', 'c4dbb6b6-6041-461d-8d8b-5e8b583364f8', '5b5f5176-6621-4a3e-b2fc-399efcd64b54', '69092c15-86bd-4cb9-bdd4-ede9f3410f75'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:40:37 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Delete snapshot completed successfully.
Sep 22 15:40:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b339dc-4cb0-47c0-b0fc-f1cfe840e362 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-cd10187a-daa1-4f1e-b55a-8c47e5646cab-delete_snapshot" released by "delete_snapshot" :: held 4.167s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Creating offline snapshot bbb72967-3b79-4e1c-93fd-e73112424676 of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:40:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-6fbc2342-d7e2-40ec-a5bb-b0319415b479 req-87a8e3a9-9703-4153-95ad-91aef1e67c79 tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:38 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0fedd7-ddc7-4645-9498-914729706db6]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:38 devstack sudo[91442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:38 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:38 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.686s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:39 devstack sudo[91465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 1G
Sep 22 15:40:39 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:39 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 1G" returned: 0 in 0.843s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:39 devstack sudo[91478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676
Sep 22 15:40:39 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:40 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676" returned: 0 in 0.399s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:40 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 is being set with open permissions: ugo+rw
Sep 22 15:40:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:40 devstack sudo[91484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676
Sep 22 15:40:40 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:40 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676" returned: 0 in 0.271s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-6fbc2342-d7e2-40ec-a5bb-b0319415b479 req-87a8e3a9-9703-4153-95ad-91aef1e67c79 tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.277s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-6fbc2342-d7e2-40ec-a5bb-b0319415b479 req-87a8e3a9-9703-4153-95ad-91aef1e67c79 tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-13dbecaa-2c36-41ce-8d26-6647d80f3ab5 tempest-SnapshotsActionsTest-769961830 None] Create snapshot completed successfully
Sep 22 15:40:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-6fbc2342-d7e2-40ec-a5bb-b0319415b479 req-87a8e3a9-9703-4153-95ad-91aef1e67c79 tempest-AttachVolumeNegativeTest-801672419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-e7c3db9a-1817-4c26-acec-6369a0c75573', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '466f9cfd-70a6-4d4e-9e50-e9305ac1f6f1', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:40:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-6fbc2342-d7e2-40ec-a5bb-b0319415b479 req-87a8e3a9-9703-4153-95ad-91aef1e67c79 tempest-AttachVolumeNegativeTest-801672419 None] attachment_update completed successfully.
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-bbb72967-3b79-4e1c-93fd-e73112424676-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-bbb72967-3b79-4e1c-93fd-e73112424676-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-quobyte-bbb72967-3b79-4e1c-93fd-e73112424676" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-bbb72967-3b79-4e1c-93fd-e73112424676" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Deleting offline snapshot bbb72967-3b79-4e1c-93fd-e73112424676 of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] snapshot_file for this snap is: volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e28bd1-866a-4428-b53c-b84e664c4c8e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:41 devstack sudo[91490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676
Sep 22 15:40:41 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Flow 'volume_create_manager' (f6d2032d-6f52-4964-abe5-2d4e4fcb5c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9fe95e-eb71-420e-a2e9-75758a2d1518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9fe95e-eb71-420e-a2e9-75758a2d1518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-471867700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244211a1-2a1e-4d23-9e8d-9ac5506e2987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c3c7675bd654e70b825aac5bb5ff8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:42Z,use_quota=True,user_id='4878f5865b114ee9902eeb7d6ec50e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bea0ce-010d-4fbc-9d92-422ad4c7edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bea0ce-010d-4fbc-9d92-422ad4c7edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8440a7c-8d9d-4e51-98dc-7e55f10f733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8440a7c-8d9d-4e51-98dc-7e55f10f733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244211a1-2a1e-4d23-9e8d-9ac5506e2987', 'volume_name': 'volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba11944-05c5-4b84-b4ea-89a1f9cec275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba11944-05c5-4b84-b4ea-89a1f9cec275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a494c6f-8cb0-4e0b-8c08-8de8cbe7235b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:41 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Volume 244211a1-2a1e-4d23-9e8d-9ac5506e2987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987', 'volume_size': 1}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-471867700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244211a1-2a1e-4d23-9e8d-9ac5506e2987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c3c7675bd654e70b825aac5bb5ff8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:42Z,use_quota=True,user_id='4878f5865b114ee9902eeb7d6ec50e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Creating volume 244211a1-2a1e-4d23-9e8d-9ac5506e2987 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:40:41 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:40:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:42 devstack sudo[91492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987 1073741824
Sep 22 15:40:42 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:42 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676" returned: 0 in 0.524s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:42 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc4d97c-6fc5-4858-a0e3-747db38f0065]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:42 devstack sudo[91498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:42 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:42 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987 1073741824" returned: 0 in 0.745s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:42 devstack sudo[91510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987
Sep 22 15:40:42 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:42 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.688s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:42 devstack sudo[91513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676
Sep 22 15:40:42 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-fd44af8d-aadf-4ac4-8bee-50f33a9e990f req-50d5ef06-4078-4f68-b3e9-b20f6c4481c4 tempest-AttachVolumeNegativeTest-801672419 None] Terminate volume connection completed successfully.
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-fd44af8d-aadf-4ac4-8bee-50f33a9e990f req-50d5ef06-4078-4f68-b3e9-b20f6c4481c4 tempest-AttachVolumeNegativeTest-801672419 None] Deleting attachment 466f9cfd-70a6-4d4e-9e50-e9305ac1f6f1. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:40:43 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987" returned: 0 in 0.539s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a494c6f-8cb0-4e0b-8c08-8de8cbe7235b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373d61c9-bc05-4784-9164-46c5f0bb5d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Volume volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987 (244211a1-2a1e-4d23-9e8d-9ac5506e2987): created successfully
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373d61c9-bc05-4784-9164-46c5f0bb5d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Flow 'volume_create_manager' (f6d2032d-6f52-4964-abe5-2d4e4fcb5c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:40:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-89405372-9e2d-4f7f-8847-19d0d6df7114 tempest-ServersNegativeTestJSON-1249099229 None] Created volume successfully.
Sep 22 15:40:43 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676" returned: 0 in 0.564s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:43 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676
Sep 22 15:40:43 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:43 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.bbb72967-3b79-4e1c-93fd-e73112424676" returned: 0 in 0.290s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-bbb72967-3b79-4e1c-93fd-e73112424676" released by "_delete_snapshot" :: held 2.232s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" released by "delete_snapshot" :: held 2.277s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:43 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Created reservations ['9e4cfe59-2199-4302-a76d-7063c15ca523', 'c142b2f7-bdd0-4861-bcd6-bfb87682e1a9', '79daea85-02aa-4a29-bc77-63819f4c6a8a', '502bba2c-cd77-458c-a32d-27de923a5085'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:40:44 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Delete snapshot completed successfully.
Sep 22 15:40:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3469837b-16f5-4e63-9383-e7788e9d4bc5 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-bbb72967-3b79-4e1c-93fd-e73112424676-delete_snapshot" released by "delete_snapshot" :: held 2.623s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Creating offline snapshot a6281484-9c86-4266-bd29-fe7d362d9fd9 of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:40:45 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c6db97-d6e3-493d-9f45-820082a6dfe4]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:45 devstack sudo[91546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:45 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:46 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.772s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:46 devstack sudo[91559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 1G
Sep 22 15:40:46 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Flow 'volume_create_manager' (d09ac314-a5db-40ca-b92f-4ad2f37db7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b104e2-f7ad-48a6-8cb5-e84f81f962f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b104e2-f7ad-48a6-8cb5-e84f81f962f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1650017443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c2209b-616c-492d-87a6-279cd380fda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c3c7675bd654e70b825aac5bb5ff8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:47Z,use_quota=True,user_id='4878f5865b114ee9902eeb7d6ec50e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06754031-5b14-4502-aaf9-7d648d0f277d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06754031-5b14-4502-aaf9-7d648d0f277d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9900ab0-4825-4ee8-937c-01f59d101d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9900ab0-4825-4ee8-937c-01f59d101d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c2209b-616c-492d-87a6-279cd380fda1', 'volume_name': 'volume-88c2209b-616c-492d-87a6-279cd380fda1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0417a7-ac32-40b0-bccd-251be3c46c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0417a7-ac32-40b0-bccd-251be3c46c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebe4e8d-7e51-4219-95be-5ad78ce781dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:46 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Volume 88c2209b-616c-492d-87a6-279cd380fda1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c2209b-616c-492d-87a6-279cd380fda1', 'volume_size': 1}
Sep 22 15:40:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:47 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 1G" returned: 0 in 0.702s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:47 devstack sudo[91626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9
Sep 22 15:40:47 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:47 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9" returned: 0 in 0.438s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:47 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 is being set with open permissions: ugo+rw
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:47 devstack sudo[91631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9
Sep 22 15:40:47 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:47 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9" returned: 0 in 0.236s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.177s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1650017443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c2209b-616c-492d-87a6-279cd380fda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c3c7675bd654e70b825aac5bb5ff8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:40:47Z,use_quota=True,user_id='4878f5865b114ee9902eeb7d6ec50e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Creating volume 88c2209b-616c-492d-87a6-279cd380fda1 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:40:47 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:40:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:47 devstack sudo[91634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1 1073741824
Sep 22 15:40:47 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:47 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0b8f550b-affa-448f-8c96-40ee2b9d97b3 tempest-SnapshotsActionsTest-769961830 None] Create snapshot completed successfully
Sep 22 15:40:48 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1 1073741824" returned: 0 in 0.413s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:48 devstack sudo[91640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1
Sep 22 15:40:48 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:48 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1" returned: 0 in 0.253s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebe4e8d-7e51-4219-95be-5ad78ce781dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c2209b-616c-492d-87a6-279cd380fda1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f8bdc5-a9d4-4050-83e0-23621cc13f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:40:48 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Volume volume-88c2209b-616c-492d-87a6-279cd380fda1 (88c2209b-616c-492d-87a6-279cd380fda1): created successfully
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f8bdc5-a9d4-4050-83e0-23621cc13f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Flow 'volume_create_manager' (d09ac314-a5db-40ca-b92f-4ad2f37db7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:40:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6474f954-507f-42d4-b76d-969e359fa416 tempest-ServersNegativeTestJSON-1249099229 None] Created volume successfully.
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-a6281484-9c86-4266-bd29-fe7d362d9fd9-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-a6281484-9c86-4266-bd29-fe7d362d9fd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Acquiring lock "cinder-quobyte-a6281484-9c86-4266-bd29-fe7d362d9fd9" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-a6281484-9c86-4266-bd29-fe7d362d9fd9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Deleting offline snapshot a6281484-9c86-4266-bd29-fe7d362d9fd9 of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] snapshot_file for this snap is: volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1edf0a-76b4-4662-98ce-87775005c364]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:49 devstack sudo[91643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9
Sep 22 15:40:49 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:49 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9" returned: 0 in 0.384s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:49 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60b519c-fa06-4d31-81ee-ca53ab2b04cb]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:49 devstack sudo[91648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:49 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:49 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.388s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:49 devstack sudo[91655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9
Sep 22 15:40:49 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "cinder-88c2209b-616c-492d-87a6-279cd380fda1-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Lock "cinder-88c2209b-616c-492d-87a6-279cd380fda1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "cinder-quobyte-88c2209b-616c-492d-87a6-279cd380fda1" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Lock "cinder-quobyte-88c2209b-616c-492d-87a6-279cd380fda1" acquired by "delete_volume" :: waited 0.041s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:50 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9" returned: 0 in 0.572s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4ac9a2-5917-43ed-a704-645ec06767a4]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:50 devstack sudo[91661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9
Sep 22 15:40:50 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:50 devstack sudo[91662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1
Sep 22 15:40:50 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:50 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.a6281484-9c86-4266-bd29-fe7d362d9fd9" returned: 0 in 0.294s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-a6281484-9c86-4266-bd29-fe7d362d9fd9" released by "_delete_snapshot" :: held 1.751s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" released by "delete_snapshot" :: held 1.779s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Created reservations ['41e10c55-e208-4edc-8bf6-51d5cf785ad6', '04a20656-1a7b-45fb-9fd5-43f8d9e81020', '351a2a99-b0e8-41ec-b9f3-6fd4fb1d0381', '4c4ab40c-0edd-43cc-ab9f-28ebb1347848'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:40:50 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1" returned: 0 in 0.433s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:50 devstack sudo[91669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1
Sep 22 15:40:50 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:50 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Delete snapshot completed successfully.
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-87f514db-48e5-4905-9307-f09f7d370f05 tempest-SnapshotsActionsTest-1380232064 None] Lock "cinder-a6281484-9c86-4266-bd29-fe7d362d9fd9-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:50 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-88c2209b-616c-492d-87a6-279cd380fda1" returned: 0 in 0.257s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Lock "cinder-quobyte-88c2209b-616c-492d-87a6-279cd380fda1" released by "delete_volume" :: held 0.750s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Created reservations ['b928b769-1117-4101-8740-928b06e0afe7', 'a767330d-adef-48ed-b1c3-1276d3113426', '65088438-60d9-4fb5-9fa9-c3469d8d82df', 'ca06eb60-ff75-4e8b-9c83-1467d414f2fc'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:51 devstack sudo[91672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:40:51 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "cinder-244211a1-2a1e-4d23-9e8d-9ac5506e2987-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Lock "cinder-244211a1-2a1e-4d23-9e8d-9ac5506e2987-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "cinder-452d78d8-86ed-4956-b19b-050b3804a321-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "cinder-quobyte-244211a1-2a1e-4d23-9e8d-9ac5506e2987" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:51 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-452d78d8-86ed-4956-b19b-050b3804a321-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Lock "cinder-quobyte-244211a1-2a1e-4d23-9e8d-9ac5506e2987" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.380s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:40:51 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Deleted volume successfully.
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "cinder-quobyte-452d78d8-86ed-4956-b19b-050b3804a321" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a61f7-c3e3-4f0f-94a6-d427fb5093f3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-69326c68-2194-46c4-9cb5-f8cbf4b6120d tempest-ServersNegativeTestJSON-1249099229 None] Lock "cinder-88c2209b-616c-492d-87a6-279cd380fda1-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-quobyte-452d78d8-86ed-4956-b19b-050b3804a321" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Deleting offline snapshot 452d78d8-86ed-4956-b19b-050b3804a321 of volume 751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] snapshot_file for this snap is: volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[02092a73-c477-401c-a9f7-20494420156e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:51 devstack sudo[91675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987
Sep 22 15:40:51 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:51 devstack sudo[91676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:51 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:51 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987" returned: 0 in 0.416s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:52 devstack sudo[91684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987
Sep 22 15:40:52 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:52 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.421s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-751a0d42-8e0a-492a-9ab5-15621f34ff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1af6b-badc-4bcf-9ab4-7d95fb970b07]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:52 devstack sudo[91687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95
Sep 22 15:40:52 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:52 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-244211a1-2a1e-4d23-9e8d-9ac5506e2987" returned: 0 in 0.280s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Lock "cinder-quobyte-244211a1-2a1e-4d23-9e8d-9ac5506e2987" released by "delete_volume" :: held 0.764s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Created reservations ['f3f9a680-916d-4e01-bca6-4a556435efe4', 'e1bf98eb-5488-4a62-bd7d-3b2711539db7', 'c76baa1c-5e07-4a66-a9b0-149aaa942e0f', 'a177187c-11e4-40ad-9cfe-e7fa9443c571'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:52 devstack sudo[91692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:40:52 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:52 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95" returned: 0 in 0.434s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:52 devstack sudo[91695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:52 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:52 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.300s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:40:52 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Deleted volume successfully.
Sep 22 15:40:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e884b63f-ad1a-4acc-9c66-010dc5b7a093 tempest-ServersNegativeTestJSON-1249099229 None] Lock "cinder-244211a1-2a1e-4d23-9e8d-9ac5506e2987-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:53 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.551s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:53 devstack sudo[91706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321
Sep 22 15:40:53 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:53 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95.452d78d8-86ed-4956-b19b-050b3804a321" returned: 0 in 0.430s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-quobyte-452d78d8-86ed-4956-b19b-050b3804a321" released by "_delete_snapshot" :: held 1.984s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" released by "delete_snapshot" :: held 2.040s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:53 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Created reservations ['e69e7347-fd15-4083-864b-c22dec7403a2', '4b8c49b2-0264-40f9-a5e0-c679c20010db', '3ad1e719-9ac3-4717-acac-047863b17923', '01c61cba-c0d1-48ca-92df-0cd3db2e995d'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:40:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Delete snapshot completed successfully.
Sep 22 15:40:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2b5d484-62aa-4505-9ec4-f72643fe9c0b tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-452d78d8-86ed-4956-b19b-050b3804a321-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "cinder-751a0d42-8e0a-492a-9ab5-15621f34ff95-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-751a0d42-8e0a-492a-9ab5-15621f34ff95-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:40:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:40:55 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaf0d76-fcd8-4194-8151-21002bc81166]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:40:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:55 devstack sudo[91737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95
Sep 22 15:40:55 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:56 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95" returned: 0 in 0.890s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:56 devstack sudo[91757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95
Sep 22 15:40:56 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:56 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-751a0d42-8e0a-492a-9ab5-15621f34ff95" returned: 0 in 0.391s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-quobyte-751a0d42-8e0a-492a-9ab5-15621f34ff95" released by "delete_volume" :: held 1.396s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Created reservations ['654b60b2-f54b-4fd4-b5c4-edca06e62841', 'c777ea35-a8b9-4631-8020-7fa2e39dae9a', '2d69649e-6b1b-45d5-96d8-8b6225afa239', 'e71a847f-16e2-4979-90fe-99747eb9d3c8'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:40:56 devstack sudo[91760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:40:56 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:40:56 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.369s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:40:56 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:40:56 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Deleted volume successfully.
Sep 22 15:40:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b350336b-0a71-4cc0-b7df-25ce170b4c08 tempest-SnapshotsActionsTest-769961830 None] Lock "cinder-751a0d42-8e0a-492a-9ab5-15621f34ff95-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:06 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=83,cinder:UPDATE=80,cinder:INSERT=20,cinder:DELETE=4 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:41:06 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=67,cinder:SELECT=80,cinder:INSERT=17,cinder:DELETE=8 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:41:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-1b113ea7-3939-4001-9348-f8203892670b req-ca035d66-c522-48f4-a6ec-d52aa9e53448 tempest-ServerActionsTestOtherA-1626109131 None] Terminate volume connection completed successfully.
Sep 22 15:41:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-1b113ea7-3939-4001-9348-f8203892670b req-ca035d66-c522-48f4-a6ec-d52aa9e53448 tempest-ServerActionsTestOtherA-1626109131 None] Deleting attachment a4dc9e4c-3020-4923-bdd5-8699aad27b36. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Flow 'volume_create_manager' (2a861809-7bb7-47ac-9214-853ebc1ceb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5604cb6a-eaf5-4a53-a295-ce1027a2b16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5604cb6a-eaf5-4a53-a295-ce1027a2b16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2011638763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27c65c1-5ce9-465e-b352-6015c2f72d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a281a6be8fa46e2b65ea02f6b18f503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:13Z,use_quota=True,user_id='342dfbbcb214489a9a78c345e8c4906c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4a120f-c133-4798-843f-1344011111e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4a120f-c133-4798-843f-1344011111e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b7a6a7-1c2e-46f9-8bb5-d14aded68aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b7a6a7-1c2e-46f9-8bb5-d14aded68aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27c65c1-5ce9-465e-b352-6015c2f72d03', 'volume_name': 'volume-e27c65c1-5ce9-465e-b352-6015c2f72d03', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e791fb-140d-453a-98c1-05507841ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e791fb-140d-453a-98c1-05507841ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd83c3b-bcc4-4542-b868-ecafa809d826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Volume e27c65c1-5ce9-465e-b352-6015c2f72d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27c65c1-5ce9-465e-b352-6015c2f72d03', 'volume_size': 1}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2011638763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27c65c1-5ce9-465e-b352-6015c2f72d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a281a6be8fa46e2b65ea02f6b18f503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:13Z,use_quota=True,user_id='342dfbbcb214489a9a78c345e8c4906c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Creating volume e27c65c1-5ce9-465e-b352-6015c2f72d03 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:41:13 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:13 devstack sudo[91928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03 1073741824
Sep 22 15:41:13 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:13 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03 1073741824" returned: 0 in 0.530s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:14 devstack sudo[91936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03
Sep 22 15:41:14 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:14 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03" returned: 0 in 0.351s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:41:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd83c3b-bcc4-4542-b868-ecafa809d826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27c65c1-5ce9-465e-b352-6015c2f72d03', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c13055-48d2-4779-8130-a3637252ee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:14 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Volume volume-e27c65c1-5ce9-465e-b352-6015c2f72d03 (e27c65c1-5ce9-465e-b352-6015c2f72d03): created successfully
Sep 22 15:41:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c13055-48d2-4779-8130-a3637252ee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Flow 'volume_create_manager' (2a861809-7bb7-47ac-9214-853ebc1ceb83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3f1d0cd4-7158-4a02-a6b5-5a1c964905b9 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Created volume successfully.
Sep 22 15:41:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Acquiring lock "cinder-e27c65c1-5ce9-465e-b352-6015c2f72d03-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "cinder-e27c65c1-5ce9-465e-b352-6015c2f72d03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Acquiring lock "cinder-quobyte-e27c65c1-5ce9-465e-b352-6015c2f72d03" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "cinder-quobyte-e27c65c1-5ce9-465e-b352-6015c2f72d03" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:16 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c428b003-7319-41e2-9e97-297c5c021d25]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:16 devstack sudo[91940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03
Sep 22 15:41:16 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:17 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03" returned: 0 in 0.433s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:17 devstack sudo[91945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03
Sep 22 15:41:17 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:17 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e27c65c1-5ce9-465e-b352-6015c2f72d03" returned: 0 in 0.317s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "cinder-quobyte-e27c65c1-5ce9-465e-b352-6015c2f72d03" released by "delete_volume" :: held 0.801s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Created reservations ['1370c972-38bb-4aba-9594-99340d024154', '7e92a857-facf-46f8-a77f-e24167d87858', '1d54377c-c17c-410a-ab28-218e165a4811', '2b74532c-e090-48e2-9163-4f3c1896ba91'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:17 devstack sudo[91948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:41:17 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:18 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.320s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:18 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:41:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Deleted volume successfully.
Sep 22 15:41:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1aa2b193-761e-479a-b394-99bf321f9f45 tempest-VolumeQuotasNegativeTestJSON-728411860 None] Lock "cinder-e27c65c1-5ce9-465e-b352-6015c2f72d03-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:20 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:41:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Flow 'volume_create_manager' (bf4fd0ed-47b3-416f-846a-96c0f7075513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba3c11f-ee93-43bd-b28f-baf60c72510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba3c11f-ee93-43bd-b28f-baf60c72510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-750888692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4e3d71-6383-4507-a80b-01d776b0ed48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36e75eb0ce04ac2ae8d182f3db47ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:20Z,use_quota=True,user_id='e75d8b94358a41f69b2113dc1343def9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6001992-4d75-4353-b707-5074aa1431b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6001992-4d75-4353-b707-5074aa1431b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd3d3b7-8f8a-45f6-8527-7d04d0063596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:20 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd3d3b7-8f8a-45f6-8527-7d04d0063596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b4e3d71-6383-4507-a80b-01d776b0ed48', 'volume_name': 'volume-7b4e3d71-6383-4507-a80b-01d776b0ed48', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd336f3350>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496734fc-964a-4036-b16e-a8588c5fb35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496734fc-964a-4036-b16e-a8588c5fb35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad99bdc7-1499-45a4-95fe-f193bfdcf23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Volume 7b4e3d71-6383-4507-a80b-01d776b0ed48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b4e3d71-6383-4507-a80b-01d776b0ed48', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd336f3350>}
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Trying to clone 7b4e3d71-6383-4507-a80b-01d776b0ed48 from image a1740871-5367-428b-bac9-1a5ec1bb8377 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:41:21 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Image download 20.69 MB at 20.69 MB/s
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54a566-ebf1-4caa-8824-b099f17a77c3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:21 devstack sudo[91979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD
Sep 22 15:41:21 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:21 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:21 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 is fetched for user e75d8b94358a41f69b2113dc1343def9. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfefbe9-983c-4361-aa8d-c3935f6b573e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:22 devstack sudo[91985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD
Sep 22 15:41:22 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:22 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-750888692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4e3d71-6383-4507-a80b-01d776b0ed48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36e75eb0ce04ac2ae8d182f3db47ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:20Z,use_quota=True,user_id='e75d8b94358a41f69b2113dc1343def9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Creating volume 7b4e3d71-6383-4507-a80b-01d776b0ed48 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:41:22 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:22 devstack sudo[91990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 1073741824
Sep 22 15:41:22 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:22 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 1073741824" returned: 0 in 0.482s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:23 devstack sudo[91996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48
Sep 22 15:41:23 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:23 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48" returned: 0 in 0.324s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Attempting download of a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 7b4e3d71-6383-4507-a80b-01d776b0ed48. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[985ca4cb-5c8b-4dc1-85ce-10ab7fb4234a]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_zgyk5v9t {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:23 devstack sudo[92001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_zgyk5v9t
Sep 22 15:41:23 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:23 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_zgyk5v9t" returned: 0 in 0.486s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_zgyk5v9t {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Flow 'volume_create_manager' (2f896a22-0ddc-4b56-a2a7-c0996fec483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e38361-b641-429a-b932-f992845132d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e38361-b641-429a-b932-f992845132d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1357968386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d53643-baa2-46f0-b66f-e3dd11be894a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4812f767f3e4e34ade738568d48ed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:24Z,use_quota=True,user_id='2c28e1e5f6d3445f9ea97d85a1716534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd6877c-73c4-49cd-bb1a-b05c013a09ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd6877c-73c4-49cd-bb1a-b05c013a09ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eca9e1d-78a9-4b41-ab99-acbfb7dc9cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eca9e1d-78a9-4b41-ab99-acbfb7dc9cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d53643-baa2-46f0-b66f-e3dd11be894a', 'volume_name': 'volume-17d53643-baa2-46f0-b66f-e3dd11be894a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0066ad5a-bb96-46fa-ac80-7c9dab63a472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0066ad5a-bb96-46fa-ac80-7c9dab63a472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc7de81-4f7d-4d52-ba42-f05554145a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:24 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Volume 17d53643-baa2-46f0-b66f-e3dd11be894a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d53643-baa2-46f0-b66f-e3dd11be894a', 'volume_size': 1}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1357968386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d53643-baa2-46f0-b66f-e3dd11be894a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4812f767f3e4e34ade738568d48ed41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:24Z,use_quota=True,user_id='2c28e1e5f6d3445f9ea97d85a1716534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Creating volume 17d53643-baa2-46f0-b66f-e3dd11be894a {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:41:24 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:24 devstack sudo[92005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_zgyk5v9t
Sep 22 15:41:24 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:24 devstack sudo[92007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a 1073741824
Sep 22 15:41:24 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:24 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_zgyk5v9t" returned: 1 in 0.405s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_zgyk5v9t' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de54da5-1487-43e1-95b9-a0928829f016]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:24 devstack sudo[92011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD
Sep 22 15:41:24 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:24 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a 1073741824" returned: 0 in 0.598s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:24 devstack sudo[92021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a
Sep 22 15:41:24 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:24 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] a1740871-5367-428b-bac9-1a5ec1bb8377 was qcow2, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:41:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:24 devstack sudo[92023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48
Sep 22 15:41:24 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:25 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a" returned: 0 in 0.329s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:41:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc7de81-4f7d-4d52-ba42-f05554145a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d53643-baa2-46f0-b66f-e3dd11be894a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde62da8-af10-4e5b-a5bd-908b2e753773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:25 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Volume volume-17d53643-baa2-46f0-b66f-e3dd11be894a (17d53643-baa2-46f0-b66f-e3dd11be894a): created successfully
Sep 22 15:41:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde62da8-af10-4e5b-a5bd-908b2e753773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Flow 'volume_create_manager' (2f896a22-0ddc-4b56-a2a7-c0996fec483d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:25 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-50793f14-b1de-40fa-aeee-4bb0666ac27e tempest-AttachVolumeNegativeTest-801672419 None] Created volume successfully.
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-1f0148bd-f8fc-49cc-a692-5715d05aa79e req-5384a1e3-b255-4dc9-9602-ece18f443954 tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-1f0148bd-f8fc-49cc-a692-5715d05aa79e req-5384a1e3-b255-4dc9-9602-ece18f443954 tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-1f0148bd-f8fc-49cc-a692-5715d05aa79e req-5384a1e3-b255-4dc9-9602-ece18f443954 tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:27 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48" returned: 0 in 2.644s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_qt3ch254devstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:41:27 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Converted 112.00 MB image at 42.35 MB/s
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-1f0148bd-f8fc-49cc-a692-5715d05aa79e req-5384a1e3-b255-4dc9-9602-ece18f443954 tempest-AttachVolumeNegativeTest-801672419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-17d53643-baa2-46f0-b66f-e3dd11be894a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d8fa6c3-5cd9-400b-bde2-8d8d84865c61', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:41:27 devstack sudo[92052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 1G
Sep 22 15:41:27 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-1f0148bd-f8fc-49cc-a692-5715d05aa79e req-5384a1e3-b255-4dc9-9602-ece18f443954 tempest-AttachVolumeNegativeTest-801672419 None] attachment_update completed successfully.
Sep 22 15:41:27 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 1G" returned: 0 in 0.512s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Downloaded image a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 7b4e3d71-6383-4507-a80b-01d776b0ed48 successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 for user e75d8b94358a41f69b2113dc1343def9 is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Marking volume 7b4e3d71-6383-4507-a80b-01d776b0ed48 as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Copying metadata from image a1740871-5367-428b-bac9-1a5ec1bb8377 to 7b4e3d71-6383-4507-a80b-01d776b0ed48. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:41:27 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Creating volume glance metadata for volume 7b4e3d71-6383-4507-a80b-01d776b0ed48 backed by image a1740871-5367-428b-bac9-1a5ec1bb8377 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad99bdc7-1499-45a4-95fe-f193bfdcf23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4e3d71-6383-4507-a80b-01d776b0ed48', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd336f3350>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba07fa26-d82a-40bf-816b-91bea700eddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:28 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Volume volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 (7b4e3d71-6383-4507-a80b-01d776b0ed48): created successfully
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba07fa26-d82a-40bf-816b-91bea700eddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Flow 'volume_create_manager' (bf4fd0ed-47b3-416f-846a-96c0f7075513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:28 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9bc40b3a-a90e-4192-aa2d-016045d17635 tempest-ServerActionsTestOtherA-1626109131 None] Created volume successfully.
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:28 devstack sudo[92482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:41:28 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:29 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.509s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:41:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:41:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:41:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:41:31 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-7707ddac-cf98-484f-ab7c-53dcfaf151dd req-2baa6880-1b23-4278-bd26-da8479c5d931 tempest-AttachVolumeNegativeTest-801672419 None] Terminate volume connection completed successfully.
Sep 22 15:41:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-7707ddac-cf98-484f-ab7c-53dcfaf151dd req-2baa6880-1b23-4278-bd26-da8479c5d931 tempest-AttachVolumeNegativeTest-801672419 None] Deleting attachment 8d8fa6c3-5cd9-400b-bde2-8d8d84865c61. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:41:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-f7ce0201-119a-4a30-a5c1-c7c33f71e5cc req-7376852f-af8a-48fc-81ef-ca29767a189b tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-f7ce0201-119a-4a30-a5c1-c7c33f71e5cc req-7376852f-af8a-48fc-81ef-ca29767a189b tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-f7ce0201-119a-4a30-a5c1-c7c33f71e5cc req-7376852f-af8a-48fc-81ef-ca29767a189b tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-f7ce0201-119a-4a30-a5c1-c7c33f71e5cc req-7376852f-af8a-48fc-81ef-ca29767a189b tempest-ServerActionsTestOtherA-1626109131 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-7b4e3d71-6383-4507-a80b-01d776b0ed48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58dd3c74-4296-4c5a-89e7-5cb87d0a8056', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:41:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-f7ce0201-119a-4a30-a5c1-c7c33f71e5cc req-7376852f-af8a-48fc-81ef-ca29767a189b tempest-ServerActionsTestOtherA-1626109131 None] attachment_update completed successfully.
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Flow 'volume_create_manager' (45d02f36-bed5-4c05-afa6-08a0ac6b435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a7cfc2-509f-4b70-8de1-84c2980c38e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a7cfc2-509f-4b70-8de1-84c2980c38e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1940243262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ce9a5d-15a0-4cf4-8215-9b12b10edcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2732ffb663460aa66339cda70f2501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:38Z,use_quota=True,user_id='6e029faec58e45159d1cc17838b79094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caca76a2-0d76-454f-ae03-b852de4ba800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caca76a2-0d76-454f-ae03-b852de4ba800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56e396e-779f-4433-ae06-0ae449d3d22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56e396e-779f-4433-ae06-0ae449d3d22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ce9a5d-15a0-4cf4-8215-9b12b10edcfd', 'volume_name': 'volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725de112-317b-43a8-8695-7b7745d1fc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725de112-317b-43a8-8695-7b7745d1fc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae375c4-260d-4c4d-a7da-35b832f05d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:37 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Volume 46ce9a5d-15a0-4cf4-8215-9b12b10edcfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd', 'volume_size': 1}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1940243262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ce9a5d-15a0-4cf4-8215-9b12b10edcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2732ffb663460aa66339cda70f2501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:38Z,use_quota=True,user_id='6e029faec58e45159d1cc17838b79094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Creating volume 46ce9a5d-15a0-4cf4-8215-9b12b10edcfd {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:41:37 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:41:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:37 devstack sudo[92623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd 1073741824
Sep 22 15:41:37 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:38 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd 1073741824" returned: 0 in 0.652s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:38 devstack sudo[92631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd
Sep 22 15:41:38 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:39 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd" returned: 0 in 0.450s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:41:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae375c4-260d-4c4d-a7da-35b832f05d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4741c1-f0b0-4959-aec4-f40e38fbe55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:39 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Volume volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd (46ce9a5d-15a0-4cf4-8215-9b12b10edcfd): created successfully
Sep 22 15:41:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4741c1-f0b0-4959-aec4-f40e38fbe55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Flow 'volume_create_manager' (45d02f36-bed5-4c05-afa6-08a0ac6b435a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-cacec935-0e96-47fd-acc3-0444c7626248 tempest-AbsoluteLimitsTests-676989937 None] Created volume successfully.
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "cinder-17d53643-baa2-46f0-b66f-e3dd11be894a-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-17d53643-baa2-46f0-b66f-e3dd11be894a-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Acquiring lock "cinder-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Lock "cinder-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "cinder-quobyte-17d53643-baa2-46f0-b66f-e3dd11be894a" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-quobyte-17d53643-baa2-46f0-b66f-e3dd11be894a" acquired by "delete_volume" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Acquiring lock "cinder-quobyte-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f41b891-ce28-4dde-800a-181f97576249]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Lock "cinder-quobyte-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd" acquired by "delete_volume" :: waited 0.047s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3db667-6196-4f31-acee-359ece7b3c13]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:40 devstack sudo[92653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a
Sep 22 15:41:40 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:40 devstack sudo[92654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd
Sep 22 15:41:40 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:41 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd" returned: 0 in 0.695s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:41 devstack sudo[92760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd
Sep 22 15:41:41 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:41 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a" returned: 0 in 0.867s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:41 devstack sudo[92768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a
Sep 22 15:41:41 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:42 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd" returned: 0 in 0.741s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Lock "cinder-quobyte-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd" released by "delete_volume" :: held 1.518s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Created reservations ['10620246-a3cc-4d7e-b5a3-8ed6fb6346e4', '287e604c-08eb-4d25-93b9-4904027867fa', 'f398e436-5d99-4979-9fae-11568811b04c', '3a54a46c-caeb-4698-aad4-49a6acda5c70'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:41:42 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17d53643-baa2-46f0-b66f-e3dd11be894a" returned: 0 in 0.934s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-quobyte-17d53643-baa2-46f0-b66f-e3dd11be894a" released by "delete_volume" :: held 1.931s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:42 devstack sudo[93107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:41:42 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Created reservations ['b5cc25ea-670d-4222-b7f1-1046347bc5d9', '74150e43-0ce2-4ad8-9d93-e263858e939a', '51a89afc-98cb-4831-b2f9-cb10b8534926', '555aa232-5ad4-4c60-aeb7-8447c6796ce9'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:42 devstack sudo[93117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:41:42 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:43 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.644s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "cinder-e7c3db9a-1817-4c26-acec-6369a0c75573-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Deleted volume successfully.
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-e7c3db9a-1817-4c26-acec-6369a0c75573-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c4c3a9-22a4-41b0-b4a6-b7097875e8bf tempest-AbsoluteLimitsTests-676989937 None] Lock "cinder-46ce9a5d-15a0-4cf4-8215-9b12b10edcfd-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "cinder-quobyte-e7c3db9a-1817-4c26-acec-6369a0c75573" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-quobyte-e7c3db9a-1817-4c26-acec-6369a0c75573" acquired by "delete_volume" :: waited 0.056s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:43 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.719s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:41:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Deleted volume successfully.
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f09422-fba6-4fa7-9b86-29084cfede14]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2c54da7f-bcde-4cf2-bb69-3a0e9f44cb9a tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-17d53643-baa2-46f0-b66f-e3dd11be894a-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:43 devstack sudo[93122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573
Sep 22 15:41:43 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:44 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573" returned: 0 in 0.593s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:44 devstack sudo[93129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573
Sep 22 15:41:44 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:45 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7c3db9a-1817-4c26-acec-6369a0c75573" returned: 0 in 0.823s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-quobyte-e7c3db9a-1817-4c26-acec-6369a0c75573" released by "delete_volume" :: held 1.555s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Created reservations ['a7a446cf-5e06-4369-a3dc-305f5c04a00f', 'bf552761-0c69-4156-9733-40f1db756194', '935ab50d-485c-4abc-9474-eb3e3e1d082e', 'c90030cd-9aaf-4076-95e0-76365de6246a'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:45 devstack sudo[93137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:41:45 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:45 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.436s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:41:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Deleted volume successfully.
Sep 22 15:41:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-881ac7f2-fa7c-4ef6-9e3c-66d77180d86f tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-e7c3db9a-1817-4c26-acec-6369a0c75573-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "cinder-dbe51289-37ed-49f6-a203-25396cd87d6f-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-dbe51289-37ed-49f6-a203-25396cd87d6f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "cinder-quobyte-dbe51289-37ed-49f6-a203-25396cd87d6f" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:41:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-quobyte-dbe51289-37ed-49f6-a203-25396cd87d6f" acquired by "delete_volume" :: waited 0.047s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:41:46 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94dd571-110f-4720-a273-b98fad99ec7b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:46 devstack sudo[93140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f
Sep 22 15:41:46 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:47 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f" returned: 0 in 0.632s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:47 devstack sudo[93145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f
Sep 22 15:41:47 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:47 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dbe51289-37ed-49f6-a203-25396cd87d6f" returned: 0 in 0.656s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-quobyte-dbe51289-37ed-49f6-a203-25396cd87d6f" released by "delete_volume" :: held 1.372s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:47 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Created reservations ['0b49784d-8fb5-41db-a9d6-5eb3a6da7cd2', '4c8b90c6-eb2b-42db-ad27-988a19adda9b', '01ed3a13-9517-4a58-93c9-e14466bd88c2', 'f898a247-92f9-4ca2-96fc-7c081fa291d1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:41:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:48 devstack sudo[93198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:41:48 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:48 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.379s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:48 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:41:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Deleted volume successfully.
Sep 22 15:41:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0dad9af2-ce13-44fa-8086-3b177c9d220c tempest-AttachVolumeNegativeTest-801672419 None] Lock "cinder-dbe51289-37ed-49f6-a203-25396cd87d6f-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Flow 'volume_create_manager' (6a3eaad7-45f4-4ecb-a4bb-721b3bf13ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3263d4-c2c3-4e4d-9ce8-d0a779695de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3263d4-c2c3-4e4d-9ce8-d0a779695de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2088148166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9661ca-b825-4f01-a7a6-de065a4bc6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6621eff019694d8bb60f49fa49a46e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:53Z,use_quota=True,user_id='701d3c4ec46849faa0b4a9bc51799a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6bd668-a9b2-4fdc-89b7-0524945a7215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6bd668-a9b2-4fdc-89b7-0524945a7215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd79309a-ffcd-4dd6-9863-96c9ca800c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd79309a-ffcd-4dd6-9863-96c9ca800c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9661ca-b825-4f01-a7a6-de065a4bc6eb', 'volume_name': 'volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56129672-002b-4c0e-b70f-2daa517f37db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56129672-002b-4c0e-b70f-2daa517f37db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95be746d-88c7-410d-b62f-f1148e9ecb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:53 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Volume df9661ca-b825-4f01-a7a6-de065a4bc6eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb', 'volume_size': 1}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2088148166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9661ca-b825-4f01-a7a6-de065a4bc6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6621eff019694d8bb60f49fa49a46e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:41:53Z,use_quota=True,user_id='701d3c4ec46849faa0b4a9bc51799a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Creating volume df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:41:53 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:41:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:53 devstack sudo[93211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb 1073741824
Sep 22 15:41:53 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:54 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb 1073741824" returned: 0 in 0.930s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:54 devstack sudo[93218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb
Sep 22 15:41:54 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:54 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb" returned: 0 in 0.559s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:41:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95be746d-88c7-410d-b62f-f1148e9ecb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd71a09e-259f-41e8-96b4-fd7f02205b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:41:54 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Volume volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb (df9661ca-b825-4f01-a7a6-de065a4bc6eb): created successfully
Sep 22 15:41:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd71a09e-259f-41e8-96b4-fd7f02205b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:41:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Flow 'volume_create_manager' (6a3eaad7-45f4-4ecb-a4bb-721b3bf13ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:41:55 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d4afafae-1495-469d-aaac-3cabbeca08b9 tempest-VolumesDeleteCascade-1964033077 None] Created volume successfully.
Sep 22 15:41:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Creating offline snapshot f5054b31-20f7-4652-9da4-b535157afc2d of volume df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:41:55 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdd5b86-e30e-4f4b-b742-947575f84e0f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:41:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:55 devstack sudo[93221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb
Sep 22 15:41:55 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:56 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb" returned: 0 in 0.796s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:56 devstack sudo[93228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d 1G
Sep 22 15:41:56 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:57 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d 1G" returned: 0 in 0.589s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:57 devstack sudo[93235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d
Sep 22 15:41:57 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:57 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d" returned: 0 in 0.516s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:57 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d is being set with open permissions: ugo+rw
Sep 22 15:41:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:57 devstack sudo[93285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d
Sep 22 15:41:57 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:57 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-028aeeac-2bf9-46f7-9ca2-bc8e95b37076 req-7b7656e2-0838-426b-83b2-b8fca5d2c289 tempest-ServerActionsTestOtherA-1626109131 None] Terminate volume connection completed successfully.
Sep 22 15:41:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-028aeeac-2bf9-46f7-9ca2-bc8e95b37076 req-7b7656e2-0838-426b-83b2-b8fca5d2c289 tempest-ServerActionsTestOtherA-1626109131 None] Deleting attachment 58dd3c74-4296-4c5a-89e7-5cb87d0a8056. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:41:58 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d" returned: 0 in 0.536s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:58 devstack sudo[93290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.info
Sep 22 15:41:58 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:58 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.info" returned: 0 in 0.408s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:58 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.info is being set with open permissions: ugo+rw
Sep 22 15:41:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:41:58 devstack sudo[93294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.info
Sep 22 15:41:58 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:41:58 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root
Sep 22 15:41:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.info" returned: 0 in 0.255s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:41:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.242s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7c3401a2-6786-41c4-8126-642c908c3c80 tempest-VolumesDeleteCascade-1964033077 None] Create snapshot completed successfully
Sep 22 15:41:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-028aeeac-2bf9-46f7-9ca2-bc8e95b37076 req-a16061c8-c15e-4330-a5c0-cf051da3ebc4 tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:41:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-028aeeac-2bf9-46f7-9ca2-bc8e95b37076 req-a16061c8-c15e-4330-a5c0-cf051da3ebc4 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:41:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-028aeeac-2bf9-46f7-9ca2-bc8e95b37076 req-a16061c8-c15e-4330-a5c0-cf051da3ebc4 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:41:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-028aeeac-2bf9-46f7-9ca2-bc8e95b37076 req-a16061c8-c15e-4330-a5c0-cf051da3ebc4 tempest-ServerActionsTestOtherA-1626109131 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-7b4e3d71-6383-4507-a80b-01d776b0ed48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c2431d2-d6e6-49f3-a3f1-7f1c69af9bba', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:41:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-028aeeac-2bf9-46f7-9ca2-bc8e95b37076 req-a16061c8-c15e-4330-a5c0-cf051da3ebc4 tempest-ServerActionsTestOtherA-1626109131 None] attachment_update completed successfully.
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Creating offline snapshot 0e0220c8-e3a8-446d-8926-3069e61da0a9 of volume df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[025bc575-0c71-4f36-8d5b-d45685ae4002]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:00 devstack sudo[93337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d
Sep 22 15:42:00 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Flow 'volume_create_manager' (4e23d7f8-a181-4956-9fdb-189db747f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391a0dac-2025-4ae7-a760-5d407cc57deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391a0dac-2025-4ae7-a760-5d407cc57deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1654086542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5d808e-283e-48e8-a8e1-2b87b6771800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b51670c4764c03a9da59200c025900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:01Z,use_quota=True,user_id='72a804ad8bf649218cd0a45c25e00533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24bde19-a5cd-4b08-83b9-00159d8ee6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24bde19-a5cd-4b08-83b9-00159d8ee6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c716ec6a-d1a8-4c6e-9a78-251cea17d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c716ec6a-d1a8-4c6e-9a78-251cea17d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5d808e-283e-48e8-a8e1-2b87b6771800', 'volume_name': 'volume-da5d808e-283e-48e8-a8e1-2b87b6771800', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:00 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2531d7a7-b74f-49a8-8f18-806bd0ab3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2531d7a7-b74f-49a8-8f18-806bd0ab3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad0aebd-5b19-41a2-b4f8-5c67e54b1352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:01 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Volume da5d808e-283e-48e8-a8e1-2b87b6771800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5d808e-283e-48e8-a8e1-2b87b6771800', 'volume_size': 1}
Sep 22 15:42:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d" returned: 0 in 0.741s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:42:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:01 devstack sudo[93749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 1G
Sep 22 15:42:01 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:01 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 1G" returned: 0 in 0.785s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:01 devstack sudo[93776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9
Sep 22 15:42:01 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:02 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9" returned: 0 in 0.327s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:02 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 is being set with open permissions: ugo+rw
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:02 devstack sudo[93781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9
Sep 22 15:42:02 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:02 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9" returned: 0 in 0.343s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1654086542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5d808e-283e-48e8-a8e1-2b87b6771800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b51670c4764c03a9da59200c025900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:01Z,use_quota=True,user_id='72a804ad8bf649218cd0a45c25e00533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Creating volume da5d808e-283e-48e8-a8e1-2b87b6771800 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:42:02 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:42:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:02 devstack sudo[93796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800 1073741824
Sep 22 15:42:02 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:02 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5b2b9757-513f-4d7c-ba29-9d1d4d63bf0a tempest-VolumesDeleteCascade-1964033077 None] Create snapshot completed successfully
Sep 22 15:42:03 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800 1073741824" returned: 0 in 0.788s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:03 devstack sudo[93825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800
Sep 22 15:42:03 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-df9661ca-b825-4f01-a7a6-de065a4bc6eb-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-df9661ca-b825-4f01-a7a6-de065a4bc6eb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Performing cascade delete. {{(pid=85987) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-0e0220c8-e3a8-446d-8926-3069e61da0a9-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-0e0220c8-e3a8-446d-8926-3069e61da0a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-df9661ca-b825-4f01-a7a6-de065a4bc6eb" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-df9661ca-b825-4f01-a7a6-de065a4bc6eb" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-0e0220c8-e3a8-446d-8926-3069e61da0a9" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-0e0220c8-e3a8-446d-8926-3069e61da0a9" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Deleting offline snapshot 0e0220c8-e3a8-446d-8926-3069e61da0a9 of volume df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] snapshot_file for this snap is: volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d84ef1f-18aa-4eee-81df-9b141785da70]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:04 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800" returned: 0 in 0.595s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad0aebd-5b19-41a2-b4f8-5c67e54b1352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5d808e-283e-48e8-a8e1-2b87b6771800', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9eeaba5-eea6-4321-904d-f74d7b5ce6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:04 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Volume volume-da5d808e-283e-48e8-a8e1-2b87b6771800 (da5d808e-283e-48e8-a8e1-2b87b6771800): created successfully
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9eeaba5-eea6-4321-904d-f74d7b5ce6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Flow 'volume_create_manager' (4e23d7f8-a181-4956-9fdb-189db747f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:04 devstack sudo[93830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9
Sep 22 15:42:04 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:04 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c9735f6a-c83d-492e-8db8-26efdc330aa3 tempest-AttachVolumeTestJSON-266297207 None] Created volume successfully.
Sep 22 15:42:04 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9" returned: 0 in 0.533s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ca88fe-278c-4e9a-bc48-40b1d20cad35]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:04 devstack sudo[93835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d
Sep 22 15:42:04 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:05 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d" returned: 0 in 0.845s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:42:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:05 devstack sudo[93845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9
Sep 22 15:42:05 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:06 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9" returned: 0 in 0.781s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:06 devstack sudo[93858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9
Sep 22 15:42:06 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-9852fffe-4b17-4946-a1c1-cda3b057173b req-276c2cf0-6fdb-4859-8320-cb5faa26ef78 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-9852fffe-4b17-4946-a1c1-cda3b057173b req-276c2cf0-6fdb-4859-8320-cb5faa26ef78 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=85,cinder:UPDATE=61,cinder:INSERT=22,cinder:DELETE=8 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-9852fffe-4b17-4946-a1c1-cda3b057173b req-276c2cf0-6fdb-4859-8320-cb5faa26ef78 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:06 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-9852fffe-4b17-4946-a1c1-cda3b057173b req-276c2cf0-6fdb-4859-8320-cb5faa26ef78 tempest-AttachVolumeTestJSON-266297207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-da5d808e-283e-48e8-a8e1-2b87b6771800', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84f2efb0-3660-4874-afb3-11c65d0f1021', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.0e0220c8-e3a8-446d-8926-3069e61da0a9" returned: 0 in 0.523s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-0e0220c8-e3a8-446d-8926-3069e61da0a9" released by "_delete_snapshot" :: held 2.920s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-df9661ca-b825-4f01-a7a6-de065a4bc6eb" released by "delete_snapshot" :: held 3.027s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-9852fffe-4b17-4946-a1c1-cda3b057173b req-276c2cf0-6fdb-4859-8320-cb5faa26ef78 tempest-AttachVolumeTestJSON-266297207 None] attachment_update completed successfully.
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=78,cinder:INSERT=19,cinder:UPDATE=76,cinder:DELETE=5 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Created reservations ['ba7dd107-7458-4288-a388-6faffd081e5f', '6d6de8e9-4de7-40f6-8ad7-083ce544f46f', 'a7e56b1a-e10b-4909-b734-92e09599b135', 'ffbf3cee-4385-4b2f-ab29-ddb786be26a8'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:07 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Delete snapshot completed successfully.
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-0e0220c8-e3a8-446d-8926-3069e61da0a9-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-f5054b31-20f7-4652-9da4-b535157afc2d-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-f5054b31-20f7-4652-9da4-b535157afc2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-df9661ca-b825-4f01-a7a6-de065a4bc6eb" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-df9661ca-b825-4f01-a7a6-de065a4bc6eb" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-f5054b31-20f7-4652-9da4-b535157afc2d" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-f5054b31-20f7-4652-9da4-b535157afc2d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Deleting offline snapshot f5054b31-20f7-4652-9da4-b535157afc2d of volume df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] snapshot_file for this snap is: volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbdf82a-f7c3-4b32-9a23-18c2e6ed852a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:07 devstack sudo[93867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d
Sep 22 15:42:07 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:08 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d" returned: 0 in 0.635s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:42:08 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d40bc53-1026-4ec2-bc6e-221b90315a5b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:08 devstack sudo[93872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb
Sep 22 15:42:08 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:08 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb" returned: 0 in 0.682s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:08 devstack sudo[93878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d
Sep 22 15:42:08 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:09 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d" returned: 0 in 0.704s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:09 devstack sudo[93893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d
Sep 22 15:42:09 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:09 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7fb714f6-5708-4c3d-aae2-52fd65f41cee tempest-GroupSnapshotsTest-466544103 None] Group tempest-GroupSnapshotsTest-Group-1150234892: creating
Sep 22 15:42:09 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb.f5054b31-20f7-4652-9da4-b535157afc2d" returned: 0 in 0.382s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-f5054b31-20f7-4652-9da4-b535157afc2d" released by "_delete_snapshot" :: held 2.585s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-df9661ca-b825-4f01-a7a6-de065a4bc6eb" released by "delete_snapshot" :: held 2.616s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7fb714f6-5708-4c3d-aae2-52fd65f41cee tempest-GroupSnapshotsTest-466544103 None] Group tempest-GroupSnapshotsTest-Group-1150234892: created successfully
Sep 22 15:42:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7fb714f6-5708-4c3d-aae2-52fd65f41cee tempest-GroupSnapshotsTest-466544103 None] Create group completed successfully.
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Created reservations ['e156e94e-da40-43cd-b9d1-c2619d6a19e1', 'b04356d4-8351-4c61-9b60-af5a00891471', 'f7ab9a0d-ab2f-46c3-831d-6142388e2103', '6022a6e0-9eae-4dbd-8a4b-6ed9af4c1cde'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Delete snapshot completed successfully.
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-f5054b31-20f7-4652-9da4-b535157afc2d-delete_snapshot" released by "delete_snapshot" :: held 2.798s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Snapshots deleted, issuing volume delete {{(pid=85987) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-df9661ca-b825-4f01-a7a6-de065a4bc6eb" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-df9661ca-b825-4f01-a7a6-de065a4bc6eb" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8be082e-8c1e-4765-9353-a7b191812457]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:10 devstack sudo[93897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb
Sep 22 15:42:10 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:10 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb" returned: 0 in 0.448s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:10 devstack sudo[93902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb
Sep 22 15:42:10 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:10 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df9661ca-b825-4f01-a7a6-de065a4bc6eb" returned: 0 in 0.273s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-df9661ca-b825-4f01-a7a6-de065a4bc6eb" released by "delete_volume" :: held 0.795s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Created reservations ['01f4017d-36f2-4c5a-9b4e-dfb2233acb3a', '3087a0ac-7b3d-4d3e-a7b8-1dbe798e21fe', '482deb48-8118-430d-8439-3404d4813a3e', '1a6e1353-7920-4323-aba2-3e30f7449474'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:11 devstack sudo[93906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:42:11 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:11 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:42:11 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Deleted volume successfully.
Sep 22 15:42:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3c78c451-d5be-40e9-9546-5daa363c098f tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-df9661ca-b825-4f01-a7a6-de065a4bc6eb-delete_volume" released by "delete_volume" :: held 7.916s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Flow 'volume_create_manager' (f3f2dae6-6137-47d3-80bc-cf1a0a19423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad6a554-4039-47b9-9ec5-93b48a62c145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad6a554-4039-47b9-9ec5-93b48a62c145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360084249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ecb5ab04-95cb-4683-a9e4-490565bbc5d6,host='devstack@QuobyteHD#QuobyteHD',id=56e549d2-2659-47b2-a30a-023591525128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e3fe4eea5c4605b09a183d4de72ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:12Z,use_quota=True,user_id='97bf972fd42c431ebdde778e0ca95727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(491c196e-3f91-41b5-955b-10acda7a8b90),volume_type_id=491c196e-3f91-41b5-955b-10acda7a8b90)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdf1b2e-8604-425b-9a1a-5d66e4e0716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdf1b2e-8604-425b-9a1a-5d66e4e0716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c218a480-ea49-4575-ba0e-8982c87ca21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c218a480-ea49-4575-ba0e-8982c87ca21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e549d2-2659-47b2-a30a-023591525128', 'volume_name': 'volume-56e549d2-2659-47b2-a30a-023591525128', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa6ddf1-5e60-47ab-b9bc-b9f5751f2266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa6ddf1-5e60-47ab-b9bc-b9f5751f2266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a032e48e-2e5f-4828-817f-f6ea849368d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:12 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Volume 56e549d2-2659-47b2-a30a-023591525128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e549d2-2659-47b2-a30a-023591525128', 'volume_size': 1}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ecb5ab04-95cb-4683-a9e4-490565bbc5d6,created_at=2026-09-22T13:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360084249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ecb5ab04-95cb-4683-a9e4-490565bbc5d6,host='devstack@QuobyteHD#QuobyteHD',id=56e549d2-2659-47b2-a30a-023591525128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e3fe4eea5c4605b09a183d4de72ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:12Z,use_quota=True,user_id='97bf972fd42c431ebdde778e0ca95727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(491c196e-3f91-41b5-955b-10acda7a8b90),volume_type_id=491c196e-3f91-41b5-955b-10acda7a8b90)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Creating volume 56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:42:12 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:42:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:12 devstack sudo[93915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 1073741824
Sep 22 15:42:12 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:13 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 1073741824" returned: 0 in 1.135s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:13 devstack sudo[93942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128
Sep 22 15:42:13 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Flow 'volume_create_manager' (1fc0036b-6922-41a5-876c-8d9280acd696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6d6a75-c928-4538-852f-bce815556986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6d6a75-c928-4538-852f-bce815556986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2098919612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e952eee6-71c2-46bd-a2e4-a59ace12afd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6621eff019694d8bb60f49fa49a46e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:13Z,use_quota=True,user_id='701d3c4ec46849faa0b4a9bc51799a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c94dda-963e-4f5b-8c2c-5325382c6a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c94dda-963e-4f5b-8c2c-5325382c6a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e5dff0-da34-4729-b1bc-9ce6cfbb9557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e5dff0-da34-4729-b1bc-9ce6cfbb9557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e952eee6-71c2-46bd-a2e4-a59ace12afd0', 'volume_name': 'volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e599988-eea3-4257-bf3f-b5b33b0b3245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e599988-eea3-4257-bf3f-b5b33b0b3245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7c6c3e-0617-492a-8de5-a13be5577c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Volume e952eee6-71c2-46bd-a2e4-a59ace12afd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0', 'volume_size': 1}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:13 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128" returned: 0 in 0.363s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.041s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2098919612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e952eee6-71c2-46bd-a2e4-a59ace12afd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6621eff019694d8bb60f49fa49a46e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:13Z,use_quota=True,user_id='701d3c4ec46849faa0b4a9bc51799a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Creating volume e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:42:13 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a032e48e-2e5f-4828-817f-f6ea849368d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e549d2-2659-47b2-a30a-023591525128', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea43866-9707-4eed-9b57-f24b16e7f3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:14 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Volume volume-56e549d2-2659-47b2-a30a-023591525128 (56e549d2-2659-47b2-a30a-023591525128): created successfully
Sep 22 15:42:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea43866-9707-4eed-9b57-f24b16e7f3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:14 devstack sudo[93961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 1073741824
Sep 22 15:42:14 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Flow 'volume_create_manager' (f3f2dae6-6137-47d3-80bc-cf1a0a19423f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8b65b9bb-6a30-458d-866a-ce73d24fbe6e tempest-GroupSnapshotsTest-466544103 None] Created volume successfully.
Sep 22 15:42:15 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 1073741824" returned: 0 in 1.176s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:15 devstack sudo[94025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0
Sep 22 15:42:15 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] GroupSnapshot 263588bc-3002-47a2-9cad-434f973447be: creating.
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Group snapshot 263588bc-3002-47a2-9cad-434f973447be: creating. {{(pid=85987) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:15 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0" returned: 0 in 0.449s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.145s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Creating offline snapshot 8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f of volume 56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7c6c3e-0617-492a-8de5-a13be5577c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c05b1e-362c-4c4f-99ad-ea387f15a7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[68303816-bcf7-45b6-a2d8-cb598879b6a0]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:15 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Volume volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 (e952eee6-71c2-46bd-a2e4-a59ace12afd0): created successfully
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c05b1e-362c-4c4f-99ad-ea387f15a7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Flow 'volume_create_manager' (1fc0036b-6922-41a5-876c-8d9280acd696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ad0fef84-0e1b-423a-84e0-d28108e74988 tempest-VolumesDeleteCascade-1964033077 None] Created volume successfully.
Sep 22 15:42:15 devstack sudo[94031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128
Sep 22 15:42:15 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:16 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128" returned: 0 in 0.581s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:16 devstack sudo[94038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f 1G
Sep 22 15:42:16 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:16 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f 1G" returned: 0 in 0.483s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e549d2-2659-47b2-a30a-023591525128 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:16 devstack sudo[94043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e549d2-2659-47b2-a30a-023591525128 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f
Sep 22 15:42:16 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:17 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e549d2-2659-47b2-a30a-023591525128 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f" returned: 0 in 0.422s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:17 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:42:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:17 devstack sudo[94048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f
Sep 22 15:42:17 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:17 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f" returned: 0 in 0.353s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:17 devstack sudo[94051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.info
Sep 22 15:42:17 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:17 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.info" returned: 0 in 0.268s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:17 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:42:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:17 devstack sudo[94054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.info
Sep 22 15:42:17 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:18 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.info" returned: 0 in 0.256s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.099s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Creating offline snapshot 8df16942-db5d-4b39-a6dd-ccfc0ba582ed of volume e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:42:18 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc9d8fd-4738-4e74-9f26-26e9cf1cc2fc]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2bd30ee8-5555-458c-b101-398c1600324d tempest-GroupSnapshotsTest-466544103 None] group_snapshot 263588bc-3002-47a2-9cad-434f973447be: created successfully
Sep 22 15:42:18 devstack sudo[94057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0
Sep 22 15:42:18 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:18 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0" returned: 0 in 0.417s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:18 devstack sudo[94062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed 1G
Sep 22 15:42:18 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:19 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed 1G" returned: 0 in 0.581s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:19 devstack sudo[94067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed
Sep 22 15:42:19 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:19 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed" returned: 0 in 0.481s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:19 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed is being set with open permissions: ugo+rw
Sep 22 15:42:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:19 devstack sudo[94073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed
Sep 22 15:42:19 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:20 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed" returned: 0 in 0.289s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:20 devstack sudo[94076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.info
Sep 22 15:42:20 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:20 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.info" returned: 0 in 0.307s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:20 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.info is being set with open permissions: ugo+rw
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:20 devstack sudo[94104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.info
Sep 22 15:42:20 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:20 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.info" returned: 0 in 0.281s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.083s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f-a5a524c0-58f3-46a6-9d64-c8f68093d202" by "_create_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f-a5a524c0-58f3-46a6-9d64-c8f68093d202" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Creating volume a5a524c0-58f3-46a6-9d64-c8f68093d202 from snapshot 8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f {{(pid=85987) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-a5a524c0-58f3-46a6-9d64-c8f68093d202" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6eaa5668-296a-4305-8736-485c36c92f2a tempest-VolumesDeleteCascade-1964033077 None] Create snapshot completed successfully
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-a5a524c0-58f3-46a6-9d64-c8f68093d202" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] snapshot: 8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f, volume: a5a524c0-58f3-46a6-9d64-c8f68093d202,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb90d57c-d0fb-4c16-90b5-d9c61caf56ce]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:20 devstack sudo[94109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f
Sep 22 15:42:20 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:21 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f" returned: 0 in 0.456s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56e549d2-2659-47b2-a30a-023591525128(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:42:21 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e28603a-cf4e-43f0-8052-07ddd72f213d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:21 devstack sudo[94118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128
Sep 22 15:42:21 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:21 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128" returned: 0 in 0.470s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:42:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:42:21 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202 not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:42:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:21 devstack sudo[94136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202
Sep 22 15:42:21 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Flow 'volume_create_manager' (c3aba162-c6fa-444c-bf9c-be4c82236e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9149ca1-c2cc-41f6-a874-ef6fa0a26652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9149ca1-c2cc-41f6-a874-ef6fa0a26652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-331893001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a8dad5-63ae-40e5-8ef6-d949132a194d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6621eff019694d8bb60f49fa49a46e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8df16942-db5d-4b39-a6dd-ccfc0ba582ed,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:22Z,use_quota=True,user_id='701d3c4ec46849faa0b4a9bc51799a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ff875-45da-4182-bd76-4c5334d09763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ff875-45da-4182-bd76-4c5334d09763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f149035-5d79-4d07-91d7-b94eedd06723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f149035-5d79-4d07-91d7-b94eedd06723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14a8dad5-63ae-40e5-8ef6-d949132a194d', 'volume_name': 'volume-14a8dad5-63ae-40e5-8ef6-d949132a194d', 'volume_size': 1, 'snapshot_id': '8df16942-db5d-4b39-a6dd-ccfc0ba582ed'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4bbf27-59bd-4dd2-acb3-23011762af8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4bbf27-59bd-4dd2-acb3-23011762af8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63602d04-1ad7-4c4b-b88d-32d883de51df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:22 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Volume 14a8dad5-63ae-40e5-8ef6-d949132a194d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14a8dad5-63ae-40e5-8ef6-d949132a194d', 'volume_size': 1, 'snapshot_id': '8df16942-db5d-4b39-a6dd-ccfc0ba582ed'}
Sep 22 15:42:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:42:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:28 devstack sudo[94161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:42:28 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:29 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.781s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:42:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:42:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:42:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:42:30 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202" returned: 0 in 8.941s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:30 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:42:30 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Converted 1024.00 MB image at 114.52 MB/s
Sep 22 15:42:30 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202 is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:42:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:30 devstack sudo[94179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202
Sep 22 15:42:30 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:31 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202" returned: 0 in 0.248s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-a5a524c0-58f3-46a6-9d64-c8f68093d202" released by "_copy_volume_from_snapshot" :: held 10.235s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f-a5a524c0-58f3-46a6-9d64-c8f68093d202" released by "_create_volume_from_snapshot" :: held 10.314s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.344s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.547s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-8df16942-db5d-4b39-a6dd-ccfc0ba582ed-14a8dad5-63ae-40e5-8ef6-d949132a194d" by "_create_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-8df16942-db5d-4b39-a6dd-ccfc0ba582ed-14a8dad5-63ae-40e5-8ef6-d949132a194d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Creating volume 14a8dad5-63ae-40e5-8ef6-d949132a194d from snapshot 8df16942-db5d-4b39-a6dd-ccfc0ba582ed {{(pid=85987) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-14a8dad5-63ae-40e5-8ef6-d949132a194d" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-14a8dad5-63ae-40e5-8ef6-d949132a194d" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] snapshot: 8df16942-db5d-4b39-a6dd-ccfc0ba582ed, volume: 14a8dad5-63ae-40e5-8ef6-d949132a194d,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7377c-b296-4a17-8f8c-d01bb6786fd7]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:31 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ed0b5e38-5f56-438e-8a49-8698682f326f tempest-GroupSnapshotsTest-466544103 None] Create group from source-snapshot-263588bc-3002-47a2-9cad-434f973447be completed successfully.
Sep 22 15:42:31 devstack sudo[94184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed
Sep 22 15:42:31 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:31 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed" returned: 0 in 0.380s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aa1d56-5760-401f-94f2-06f8bd00ca01]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:31 devstack sudo[94189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0
Sep 22 15:42:31 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:31 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0" returned: 0 in 0.400s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:42:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:32 devstack sudo[94199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d
Sep 22 15:42:32 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-a5a524c0-58f3-46a6-9d64-c8f68093d202" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-a5a524c0-58f3-46a6-9d64-c8f68093d202" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:32 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d3280e-03fd-4441-89d6-4d4d23474bd4]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:32 devstack sudo[94224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202
Sep 22 15:42:32 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:33 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202" returned: 0 in 0.643s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:33 devstack sudo[94237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202
Sep 22 15:42:33 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:33 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a5a524c0-58f3-46a6-9d64-c8f68093d202" returned: 0 in 0.658s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-a5a524c0-58f3-46a6-9d64-c8f68093d202" released by "delete_volume" :: held 1.371s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:34 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Created reservations ['7e6cd1f6-1d4f-4158-a092-77b34982c902'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:34 devstack cinder-volume[85987]: WARNING cinder.quota [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1818100560 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1818100560, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:42:34 devstack cinder-volume[85987]: WARNING cinder.quota [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1818100560 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1818100560, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:42:34 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Created reservations ['2cf023b7-1073-4744-a8fd-4ca0390e1870', '3a732882-e4d7-4607-aa80-be06fb4d8a54', 'a0fd6ea8-cfef-4bf7-b697-25167e719a36', 'fd3e3862-87eb-45be-b053-31d7acd869f8'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:34 devstack sudo[94242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:42:34 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:34 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-311c6bd4-f4f2-4b3e-a7b8-2a9bef68ad3b tempest-ServerActionsTestOtherA-1626109131 None] Terminate volume connection completed successfully.
Sep 22 15:42:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-311c6bd4-f4f2-4b3e-a7b8-2a9bef68ad3b tempest-ServerActionsTestOtherA-1626109131 None] Deleting attachment 8c2431d2-d6e6-49f3-a3f1-7f1c69af9bba. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:42:35 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.509s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:42:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6e1df667-51f4-4b58-99d0-9acccadaadf0 tempest-GroupSnapshotsTest-466544103 None] Delete group completed successfully.
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "cinder-7b4e3d71-6383-4507-a80b-01d776b0ed48-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Lock "cinder-7b4e3d71-6383-4507-a80b-01d776b0ed48-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] group_snapshot 263588bc-3002-47a2-9cad-434f973447be: deleting
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "cinder-quobyte-7b4e3d71-6383-4507-a80b-01d776b0ed48" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Lock "cinder-quobyte-7b4e3d71-6383-4507-a80b-01d776b0ed48" acquired by "delete_volume" :: waited 0.066s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] group_snapshot 263588bc-3002-47a2-9cad-434f973447be: deleting {{(pid=85987) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a95a4b-1926-4e59-bc84-1e36cf5a29f5]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-56e549d2-2659-47b2-a30a-023591525128" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-56e549d2-2659-47b2-a30a-023591525128" acquired by "delete_snapshot" :: waited 0.052s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Deleting offline snapshot 8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f of volume 56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] snapshot_file for this snap is: volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3108ee9-e8de-465d-9882-d5f5dd8c1789]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:35 devstack sudo[94246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48
Sep 22 15:42:35 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:36 devstack sudo[94247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f
Sep 22 15:42:36 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "cinder-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Lock "cinder-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "cinder-quobyte-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Lock "cinder-quobyte-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a" acquired by "delete_volume" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:36 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f61047-c296-4d7e-98c5-aa06ef3843f7]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:36 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48" returned: 0 in 1.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:36 devstack sudo[94260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48
Sep 22 15:42:36 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:36 devstack sudo[94257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a
Sep 22 15:42:36 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:37 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f" returned: 0 in 1.377s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56e549d2-2659-47b2-a30a-023591525128(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9683ea98-1d00-4a90-a676-91c06dbd2d8f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:37 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b4e3d71-6383-4507-a80b-01d776b0ed48" returned: 0 in 0.483s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Lock "cinder-quobyte-7b4e3d71-6383-4507-a80b-01d776b0ed48" released by "delete_volume" :: held 2.011s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:37 devstack sudo[94265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128
Sep 22 15:42:37 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG cinder.quota [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Created reservations ['9ac50209-e134-4623-a642-5ff0ee602c7c', '7f639ae5-f8cf-4932-9c31-7c436ab6038c', '51b1a696-eda8-468c-ab60-e3a169f4f64d', '45dd3040-e704-47b9-a8ef-57b863b54755'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:37 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a" returned: 0 in 0.976s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:37 devstack sudo[94272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a
Sep 22 15:42:37 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:37 devstack sudo[94274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:42:37 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:38 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.566s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG cinder.manager [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:42:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Deleted volume successfully.
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-5870bc65-7122-42c7-863b-2acc9730aca5 req-8cfaf115-8d3f-4f06-b4c5-8b28b30037d6 tempest-ServerActionsTestOtherA-1626109131 None] Lock "cinder-7b4e3d71-6383-4507-a80b-01d776b0ed48-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:38 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a" returned: 0 in 0.809s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Lock "cinder-quobyte-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a" released by "delete_volume" :: held 1.921s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Created reservations ['bb0ff90f-e027-425e-a100-519ad96cdd68', 'b4824e8f-ef4a-45a4-acea-13e26dbb37f1', 'b5401e2a-c753-499c-beba-e5d7c5e3e39f', '0c58c8df-18dd-4dc7-bc81-3db28130a43e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:38 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128" returned: 0 in 1.526s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:38 devstack sudo[94282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f
Sep 22 15:42:38 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:39 devstack sudo[94285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:42:39 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:39 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.550s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:39 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:42:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Deleted volume successfully.
Sep 22 15:42:39 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ea657ce-2647-4efa-bde1-511520b29ca2 tempest-ServerActionsTestOtherA-1626109131 None] Lock "cinder-ab2006c7-07ca-44dd-8a78-8c7c89ab6d7a-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f" returned: 0 in 0.849s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:39 devstack sudo[94299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f
Sep 22 15:42:39 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:40 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128.8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f" returned: 0 in 0.613s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-8a7fa15a-0bff-40d1-b7c9-5e0ea69f2b8f" released by "_delete_snapshot" :: held 4.765s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-56e549d2-2659-47b2-a30a-023591525128" released by "delete_snapshot" :: held 4.837s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:40 devstack cinder-volume[85987]: WARNING cinder.quota [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1818100560 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1818100560, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:42:40 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] Created reservations ['d054cd31-cc4b-4f8c-86b6-ca3ebf34a95c', '6224d781-d3d9-4148-9a83-56558a78632e', 'd89a3f55-aef6-4864-b119-06ed21c3f790', '9f8884b2-1386-4000-bbfe-651b32e52e23'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:41 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f8b160ca-975c-4486-a3d3-d797bd3d6268 tempest-GroupSnapshotsTest-466544103 None] group_snapshot 263588bc-3002-47a2-9cad-434f973447be: deleted successfully
Sep 22 15:42:41 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-79dfa736-1921-4161-b95c-cf72b8124ce6 req-5f0d8d6a-10e2-4f09-9a4c-c28df8359dc4 tempest-AttachVolumeTestJSON-266297207 None] Terminate volume connection completed successfully.
Sep 22 15:42:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-79dfa736-1921-4161-b95c-cf72b8124ce6 req-5f0d8d6a-10e2-4f09-9a4c-c28df8359dc4 tempest-AttachVolumeTestJSON-266297207 None] Deleting attachment 84f2efb0-3660-4874-afb3-11c65d0f1021. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:42:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-56e549d2-2659-47b2-a30a-023591525128" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-56e549d2-2659-47b2-a30a-023591525128" acquired by "delete_volume" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:42 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23f80ba-f68c-4c88-a61a-9cd7f0ae92fb]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:42 devstack sudo[94339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128
Sep 22 15:42:42 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:43 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128" returned: 0 in 0.764s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:43 devstack sudo[94348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128
Sep 22 15:42:43 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:43 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d" returned: 0 in 11.542s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0, size 1024.00 MB, duration 11.54 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:42:43 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Converted 1024.00 MB image at 88.71 MB/s
Sep 22 15:42:43 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d is being set with open permissions: ugo+rw
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:43 devstack sudo[94351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d
Sep 22 15:42:43 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:43 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56e549d2-2659-47b2-a30a-023591525128" returned: 0 in 0.515s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-56e549d2-2659-47b2-a30a-023591525128" released by "delete_volume" :: held 1.450s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Created reservations ['e14cb21c-8ebe-4da7-843a-7ca4e8d8236f'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:43 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d" returned: 0 in 0.316s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-14a8dad5-63ae-40e5-8ef6-d949132a194d" released by "_copy_volume_from_snapshot" :: held 12.739s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:43 devstack cinder-volume[85987]: WARNING cinder.db.api [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1818100560']
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Created reservations ['e4b57178-8754-4e04-95a6-ed113f6ffe4e', 'd57ce368-8133-4154-9866-70c474879bc7', 'ccd7286d-655e-47d0-9e1f-fa9b489c8c26', 'dbeaa334-780c-416b-8a18-d7895f1343a4'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-8df16942-db5d-4b39-a6dd-ccfc0ba582ed-14a8dad5-63ae-40e5-8ef6-d949132a194d" released by "_create_volume_from_snapshot" :: held 12.836s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.855s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63602d04-1ad7-4c4b-b88d-32d883de51df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a8dad5-63ae-40e5-8ef6-d949132a194d', 'volume_size': 1, 'snapshot_id': '8df16942-db5d-4b39-a6dd-ccfc0ba582ed'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1324bf8-efd8-414e-a8f5-07977c857b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Volume volume-14a8dad5-63ae-40e5-8ef6-d949132a194d (14a8dad5-63ae-40e5-8ef6-d949132a194d): created successfully
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1324bf8-efd8-414e-a8f5-07977c857b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Flow 'volume_create_manager' (c3aba162-c6fa-444c-bf9c-be4c82236e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:44 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-63d65613-a508-4901-8325-71e74632619a tempest-VolumesDeleteCascade-1964033077 None] Created volume successfully.
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:44 devstack sudo[94355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:42:44 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-e952eee6-71c2-46bd-a2e4-a59ace12afd0-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-e952eee6-71c2-46bd-a2e4-a59ace12afd0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:44 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.282s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:42:44 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-98e446d6-090c-4f4f-8c84-3083c623e68a tempest-GroupSnapshotsTest-466544103 None] Delete group completed successfully.
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Performing cascade delete. {{(pid=85987) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-8df16942-db5d-4b39-a6dd-ccfc0ba582ed-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-8df16942-db5d-4b39-a6dd-ccfc0ba582ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-e952eee6-71c2-46bd-a2e4-a59ace12afd0" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-e952eee6-71c2-46bd-a2e4-a59ace12afd0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-8df16942-db5d-4b39-a6dd-ccfc0ba582ed" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-8df16942-db5d-4b39-a6dd-ccfc0ba582ed" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Deleting offline snapshot 8df16942-db5d-4b39-a6dd-ccfc0ba582ed of volume e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] snapshot_file for this snap is: volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc229b9-fc72-4ece-b158-0e65c6f0a300]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:44 devstack sudo[94358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed
Sep 22 15:42:44 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:45 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed" returned: 0 in 0.536s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:42:45 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28e427f-64e2-4bad-adb8-e5b887483a07]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:45 devstack sudo[94363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0
Sep 22 15:42:45 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-92f7df77-d7e7-48ac-abe3-09916ea938b7 tempest-GroupSnapshotsTest-466544103 None] Group tempest-GroupSnapshotsTest-Group-275026534: creating
Sep 22 15:42:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-92f7df77-d7e7-48ac-abe3-09916ea938b7 tempest-GroupSnapshotsTest-466544103 None] Group tempest-GroupSnapshotsTest-Group-275026534: created successfully
Sep 22 15:42:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-92f7df77-d7e7-48ac-abe3-09916ea938b7 tempest-GroupSnapshotsTest-466544103 None] Create group completed successfully.
Sep 22 15:42:45 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0" returned: 0 in 0.723s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:45 devstack sudo[94368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed
Sep 22 15:42:45 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:46 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed" returned: 0 in 0.538s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:46 devstack sudo[94391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed
Sep 22 15:42:46 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:46 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0.8df16942-db5d-4b39-a6dd-ccfc0ba582ed" returned: 0 in 0.425s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-8df16942-db5d-4b39-a6dd-ccfc0ba582ed" released by "_delete_snapshot" :: held 2.364s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-e952eee6-71c2-46bd-a2e4-a59ace12afd0" released by "delete_snapshot" :: held 2.396s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:46 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Created reservations ['e10cf2d4-bba3-4110-8a16-8f998ea5e118', '7e9b2711-222e-4310-a08c-35b155386639', '668534db-df05-41bb-bf11-c93286955c79', 'd31193d4-b5a7-44ec-babf-bc16765c6e3a'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:47 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Delete snapshot completed successfully.
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-8df16942-db5d-4b39-a6dd-ccfc0ba582ed-delete_snapshot" released by "delete_snapshot" :: held 2.664s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Snapshots deleted, issuing volume delete {{(pid=85987) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-e952eee6-71c2-46bd-a2e4-a59ace12afd0" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-e952eee6-71c2-46bd-a2e4-a59ace12afd0" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c263879-cfd7-418f-b875-583201a9bbfa]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:47 devstack sudo[94419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0
Sep 22 15:42:47 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Flow 'volume_create_manager' (022639f7-883d-42f8-815d-42251363b264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307c99a8-002e-4779-bd9c-6d6fbc8c67e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307c99a8-002e-4779-bd9c-6d6fbc8c67e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1224811337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5056f5b5-eeaa-4267-902e-d00198ba91b5,host='devstack@QuobyteHD#QuobyteHD',id=75492d5e-b6d8-46e6-b405-76818b0529b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e3fe4eea5c4605b09a183d4de72ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:48Z,use_quota=True,user_id='97bf972fd42c431ebdde778e0ca95727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66a2c2bf-cbd3-4c09-89fb-aec3c9990696),volume_type_id=66a2c2bf-cbd3-4c09-89fb-aec3c9990696)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3df04f-2c07-43d1-84ea-5cefc79e90c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3df04f-2c07-43d1-84ea-5cefc79e90c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9495c28-f144-4079-94dd-0df9c4b06d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9495c28-f144-4079-94dd-0df9c4b06d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75492d5e-b6d8-46e6-b405-76818b0529b4', 'volume_name': 'volume-75492d5e-b6d8-46e6-b405-76818b0529b4', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3ed4fb-df30-446a-a15d-29eb66e026b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3ed4fb-df30-446a-a15d-29eb66e026b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e25e3a6-b2df-48d1-a941-605e4b763969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:47 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Volume 75492d5e-b6d8-46e6-b405-76818b0529b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75492d5e-b6d8-46e6-b405-76818b0529b4', 'volume_size': 1}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5056f5b5-eeaa-4267-902e-d00198ba91b5,created_at=2026-09-22T13:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1224811337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5056f5b5-eeaa-4267-902e-d00198ba91b5,host='devstack@QuobyteHD#QuobyteHD',id=75492d5e-b6d8-46e6-b405-76818b0529b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e3fe4eea5c4605b09a183d4de72ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:48Z,use_quota=True,user_id='97bf972fd42c431ebdde778e0ca95727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66a2c2bf-cbd3-4c09-89fb-aec3c9990696),volume_type_id=66a2c2bf-cbd3-4c09-89fb-aec3c9990696)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Creating volume 75492d5e-b6d8-46e6-b405-76818b0529b4 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:42:47 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:42:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:47 devstack sudo[94464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4 1073741824
Sep 22 15:42:47 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:48 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0" returned: 0 in 0.914s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:48 devstack sudo[94477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0
Sep 22 15:42:48 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:48 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e952eee6-71c2-46bd-a2e4-a59ace12afd0" returned: 0 in 0.562s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:48 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-e952eee6-71c2-46bd-a2e4-a59ace12afd0" released by "delete_volume" :: held 1.701s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4 1073741824" returned: 0 in 0.983s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:48 devstack sudo[94487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4
Sep 22 15:42:48 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:48 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Created reservations ['46ce4fd0-e329-4406-8d04-aa40aa21832c', '0a2286af-9a96-44fe-b39f-8a4f3af6d633', 'e40ce8a2-5b53-4583-997c-365679f87961', '9dbbeb89-1a42-4994-8522-5b814ddcf3d9'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:49 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4" returned: 0 in 0.322s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:49 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:42:49 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e25e3a6-b2df-48d1-a941-605e4b763969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75492d5e-b6d8-46e6-b405-76818b0529b4', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b179f9a1-2427-42c8-9a06-e0311be38b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:49 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Volume volume-75492d5e-b6d8-46e6-b405-76818b0529b4 (75492d5e-b6d8-46e6-b405-76818b0529b4): created successfully
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b179f9a1-2427-42c8-9a06-e0311be38b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Flow 'volume_create_manager' (022639f7-883d-42f8-815d-42251363b264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a9451033-14a3-438b-8cf1-bd425c1ce9ba tempest-GroupSnapshotsTest-466544103 None] Created volume successfully.
Sep 22 15:42:49 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.359s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:42:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Deleted volume successfully.
Sep 22 15:42:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0405ee8f-b8c1-41ce-af17-7385267013d4 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-e952eee6-71c2-46bd-a2e4-a59ace12afd0-delete_volume" released by "delete_volume" :: held 5.236s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-14a8dad5-63ae-40e5-8ef6-d949132a194d-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-14a8dad5-63ae-40e5-8ef6-d949132a194d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "cinder-quobyte-14a8dad5-63ae-40e5-8ef6-d949132a194d" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:42:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-14a8dad5-63ae-40e5-8ef6-d949132a194d" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:42:50 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbea458-faa1-4079-9341-e4e33050405e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:50 devstack sudo[94499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d
Sep 22 15:42:50 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:42:51 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Flow 'volume_create_manager' (988a8c3e-6b2f-4c9a-8574-1994b90b9d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10384863-fc86-4297-93bb-336b3b2b4d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d" returned: 0 in 0.715s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10384863-fc86-4297-93bb-336b3b2b4d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-723696810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5056f5b5-eeaa-4267-902e-d00198ba91b5,host='devstack@QuobyteHD#QuobyteHD',id=9c99840a-cfc5-4ad4-94bc-38591e51aa8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e3fe4eea5c4605b09a183d4de72ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:51Z,use_quota=True,user_id='97bf972fd42c431ebdde778e0ca95727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66a2c2bf-cbd3-4c09-89fb-aec3c9990696),volume_type_id=66a2c2bf-cbd3-4c09-89fb-aec3c9990696)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5330ada6-ada1-4308-a622-e4cb5f62f08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:51 devstack sudo[94504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d
Sep 22 15:42:51 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5330ada6-ada1-4308-a622-e4cb5f62f08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78465e67-9de6-4609-8228-0d0f84c20b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78465e67-9de6-4609-8228-0d0f84c20b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c99840a-cfc5-4ad4-94bc-38591e51aa8f', 'volume_name': 'volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a538622-c9a1-4e8c-acf7-d35fe43337d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a538622-c9a1-4e8c-acf7-d35fe43337d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eea102c-c812-484c-ada4-f1c7e46b0d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:51 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Volume 9c99840a-cfc5-4ad4-94bc-38591e51aa8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f', 'volume_size': 1}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5056f5b5-eeaa-4267-902e-d00198ba91b5,created_at=2026-09-22T13:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-723696810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5056f5b5-eeaa-4267-902e-d00198ba91b5,host='devstack@QuobyteHD#QuobyteHD',id=9c99840a-cfc5-4ad4-94bc-38591e51aa8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e3fe4eea5c4605b09a183d4de72ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:51Z,use_quota=True,user_id='97bf972fd42c431ebdde778e0ca95727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66a2c2bf-cbd3-4c09-89fb-aec3c9990696),volume_type_id=66a2c2bf-cbd3-4c09-89fb-aec3c9990696)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Creating volume 9c99840a-cfc5-4ad4-94bc-38591e51aa8f {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:42:51 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:51 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f 1073741824
Sep 22 15:42:51 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:51 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14a8dad5-63ae-40e5-8ef6-d949132a194d" returned: 0 in 0.436s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-quobyte-14a8dad5-63ae-40e5-8ef6-d949132a194d" released by "delete_volume" :: held 1.228s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Created reservations ['f17b4a9d-8c4c-492e-afbd-a8c205451b13', '685b9ad2-30c7-4e03-b207-6ed09801809e', 'ce984be2-cfd4-42a2-a2fc-1092cb0461ab', '36b3bdd0-589f-4cd2-8c48-eaac8dacdad6'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:51 devstack sudo[94513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:42:51 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:51 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f 1073741824" returned: 0 in 0.716s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:51 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.258s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:51 devstack sudo[94516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f
Sep 22 15:42:52 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:52 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:42:52 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Deleted volume successfully.
Sep 22 15:42:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23f231d5-af5f-49ba-8f63-5cdf62f99f28 tempest-VolumesDeleteCascade-1964033077 None] Lock "cinder-14a8dad5-63ae-40e5-8ef6-d949132a194d-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:42:52 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" returned: 0 in 0.309s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:42:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eea102c-c812-484c-ada4-f1c7e46b0d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ff881c-e7e2-49a7-8fa9-cdb24504df56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:52 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Volume volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f (9c99840a-cfc5-4ad4-94bc-38591e51aa8f): created successfully
Sep 22 15:42:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ff881c-e7e2-49a7-8fa9-cdb24504df56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Flow 'volume_create_manager' (988a8c3e-6b2f-4c9a-8574-1994b90b9d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:52 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-328c0295-b7c2-4ce2-9f06-5263d134de59 tempest-GroupSnapshotsTest-466544103 None] Created volume successfully.
Sep 22 15:42:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2a233b55-d1cc-4467-ab4c-ba42295e008d tempest-GroupSnapshotsTest-466544103 None] Update group completed successfully.
Sep 22 15:42:54 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-665a64a3-015f-409b-b4ac-a7db426c9b8a tempest-GroupSnapshotsTest-466544103 None] Update group completed successfully.
Sep 22 15:42:56 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-199d77a4-2923-47aa-991e-02272de771dc tempest-GroupSnapshotsTest-466544103 None] Update group completed successfully.
Sep 22 15:42:57 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-410233fa-8cfe-4fc0-a327-fbc3b3b756eb tempest-GroupSnapshotsTest-466544103 None] Update group completed successfully.
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Flow 'volume_create_manager' (a7d90465-28a9-43fa-a613-2aebf6fe6767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db133cab-b9b3-44ed-95c4-0e69d4f8cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db133cab-b9b3-44ed-95c4-0e69d4f8cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1951467613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e7156d-7ddb-4d70-b8fa-e44702c1cebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6467222dabcc493584a1b9114db1ab64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:58Z,use_quota=True,user_id='2a86974c8d694ed7992d82dc3a27c660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52798047-4f36-4051-bdb0-ada28c9066fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52798047-4f36-4051-bdb0-ada28c9066fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ea2464-24d4-4419-bc87-77295ed48b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ea2464-24d4-4419-bc87-77295ed48b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e7156d-7ddb-4d70-b8fa-e44702c1cebe', 'volume_name': 'volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f360164f-0a3f-4815-8a0b-3ea2f2c11204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f360164f-0a3f-4815-8a0b-3ea2f2c11204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7146d4f5-0d49-487a-8016-ee0ad7a890a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:58 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Volume 74e7156d-7ddb-4d70-b8fa-e44702c1cebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe', 'volume_size': 1}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1951467613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e7156d-7ddb-4d70-b8fa-e44702c1cebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6467222dabcc493584a1b9114db1ab64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:58Z,use_quota=True,user_id='2a86974c8d694ed7992d82dc3a27c660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Creating volume 74e7156d-7ddb-4d70-b8fa-e44702c1cebe {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:42:58 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:58 devstack sudo[94521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe 1073741824
Sep 22 15:42:58 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:58 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe 1073741824" returned: 0 in 0.536s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:58 devstack sudo[94527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe
Sep 22 15:42:58 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:59 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" returned: 0 in 0.335s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7146d4f5-0d49-487a-8016-ee0ad7a890a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08749b37-fbfe-4e1a-9fb9-58e7afafa90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] GroupSnapshot d6076619-8bd1-4e44-83e7-e9f9b983acbd: creating.
Sep 22 15:42:59 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Volume volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe (74e7156d-7ddb-4d70-b8fa-e44702c1cebe): created successfully
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08749b37-fbfe-4e1a-9fb9-58e7afafa90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Flow 'volume_create_manager' (a7d90465-28a9-43fa-a613-2aebf6fe6767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Group snapshot d6076619-8bd1-4e44-83e7-e9f9b983acbd: creating. {{(pid=85987) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 22 15:42:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-15d6daba-4a78-4f78-99b3-41c1ccf6c1e6 req-094c75c6-30ff-480e-bcef-9fc8b288a1d5 tempest-VolumesSnapshotsTestJSON-556393961 None] Created volume successfully.
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Creating offline snapshot 52074f63-d947-45f8-b852-4b947d0577f5 of volume 75492d5e-b6d8-46e6-b405-76818b0529b4 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Flow 'volume_create_manager' (b876b387-fa10-400e-844f-df47cdef3438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c48bc0-013d-4b27-9d6e-bbb3cc45c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f44aa9b-f8d1-4e4c-8531-d52f4d9eb8ed]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c48bc0-013d-4b27-9d6e-bbb3cc45c990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-866565931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86236f0e587486e8bf9aef06f6ada95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:59Z,use_quota=True,user_id='db67c4f0c5944ca193087035b49b4c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1de7b5b-88a6-4bcc-93c9-5b2deb649d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1de7b5b-88a6-4bcc-93c9-5b2deb649d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa68cd26-a06d-46d9-ab72-6065e2b5a1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa68cd26-a06d-46d9-ab72-6065e2b5a1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5', 'volume_name': 'volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965ded11-61b9-4630-9cab-a5f53e3fe403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965ded11-61b9-4630-9cab-a5f53e3fe403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5049e8d-f4d0-4404-81b7-3a3c86acdcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:42:59 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Volume c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5', 'volume_size': 1}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:42:59 devstack sudo[94530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4
Sep 22 15:42:59 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:42:59 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4" returned: 0 in 0.372s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:42:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:42:59 devstack sudo[94535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 1G
Sep 22 15:42:59 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:00 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 1G" returned: 0 in 0.369s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75492d5e-b6d8-46e6-b405-76818b0529b4 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:00 devstack sudo[94541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75492d5e-b6d8-46e6-b405-76818b0529b4 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5
Sep 22 15:43:00 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:00 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75492d5e-b6d8-46e6-b405-76818b0529b4 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5" returned: 0 in 0.341s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:00 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:00 devstack sudo[94546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5
Sep 22 15:43:00 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:00 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5" returned: 0 in 0.303s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:00 devstack sudo[94549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.info
Sep 22 15:43:00 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:01 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.info" returned: 0 in 0.288s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:01 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:01 devstack sudo[94552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.info
Sep 22 15:43:01 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:01 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.info" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Creating offline snapshot b6ef1fa6-0f7d-46b4-a708-16d28517c587 of volume 9c99840a-cfc5-4ad4-94bc-38591e51aa8f {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ae42f-31dd-489e-a0c7-7e4952d5145a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:01 devstack sudo[94565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f
Sep 22 15:43:01 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:01 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" returned: 0 in 0.368s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:01 devstack sudo[94571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 1G
Sep 22 15:43:01 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:02 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 1G" returned: 0 in 0.396s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:02 devstack sudo[94577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587
Sep 22 15:43:02 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:02 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587" returned: 0 in 0.282s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:02 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:02 devstack sudo[94582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587
Sep 22 15:43:02 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:02 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587" returned: 0 in 0.246s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:02 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.info
Sep 22 15:43:02 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:02 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.info" returned: 0 in 0.247s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:02 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:02 devstack sudo[94588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.info
Sep 22 15:43:02 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:03 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.info" returned: 0 in 0.255s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.602s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Creating offline snapshot 00e66d56-cac1-4724-8b67-e8b92b48d272 of volume 74e7156d-7ddb-4d70-b8fa-e44702c1cebe {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c4b20e-e960-4836-98b8-e33a1744f4cd]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:03 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f02cda9c-a41e-43ba-9976-dc7b2141bab8 tempest-GroupSnapshotsTest-466544103 None] group_snapshot d6076619-8bd1-4e44-83e7-e9f9b983acbd: created successfully
Sep 22 15:43:03 devstack sudo[94591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe
Sep 22 15:43:03 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:03 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] group_snapshot d6076619-8bd1-4e44-83e7-e9f9b983acbd: deleting
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] group_snapshot d6076619-8bd1-4e44-83e7-e9f9b983acbd: deleting {{(pid=85987) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-75492d5e-b6d8-46e6-b405-76818b0529b4" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-75492d5e-b6d8-46e6-b405-76818b0529b4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-52074f63-d947-45f8-b852-4b947d0577f5" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-52074f63-d947-45f8-b852-4b947d0577f5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Deleting offline snapshot 52074f63-d947-45f8-b852-4b947d0577f5 of volume 75492d5e-b6d8-46e6-b405-76818b0529b4 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] snapshot_file for this snap is: volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:43:03 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" returned: 0 in 0.438s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2711b882-ccaf-4038-ab8c-37d030c03148]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:03 devstack sudo[94596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 1G
Sep 22 15:43:03 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:03 devstack sudo[94597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5
Sep 22 15:43:03 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:04 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5" returned: 0 in 0.430s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75492d5e-b6d8-46e6-b405-76818b0529b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ebddd4-8676-4d3b-b84e-0c4abb8a17c8]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:04 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 1G" returned: 0 in 0.485s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:04 devstack sudo[94646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272
Sep 22 15:43:04 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:04 devstack sudo[94645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4
Sep 22 15:43:04 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:04 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:04 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 is being set with open permissions: ugo+rw
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:04 devstack sudo[94656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272
Sep 22 15:43:04 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:04 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4" returned: 0 in 0.395s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:04 devstack sudo[94660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5
Sep 22 15:43:04 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:04 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272" returned: 0 in 0.259s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:04 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.info
Sep 22 15:43:04 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:04 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5" returned: 0 in 0.367s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:04 devstack sudo[94669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5
Sep 22 15:43:04 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:05 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.info" returned: 0 in 0.264s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:05 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.info is being set with open permissions: ugo+rw
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:05 devstack sudo[94672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.info
Sep 22 15:43:05 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:05 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4.52074f63-d947-45f8-b852-4b947d0577f5" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-52074f63-d947-45f8-b852-4b947d0577f5" released by "_delete_snapshot" :: held 1.596s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-75492d5e-b6d8-46e6-b405-76818b0529b4" released by "delete_snapshot" :: held 1.620s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-b6ef1fa6-0f7d-46b4-a708-16d28517c587" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-b6ef1fa6-0f7d-46b4-a708-16d28517c587" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Deleting offline snapshot b6ef1fa6-0f7d-46b4-a708-16d28517c587 of volume 9c99840a-cfc5-4ad4-94bc-38591e51aa8f {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] snapshot_file for this snap is: volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:43:05 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaca64f-b7b1-408b-b014-0fa146d60724]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.info" returned: 0 in 0.280s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.970s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-866565931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86236f0e587486e8bf9aef06f6ada95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:42:59Z,use_quota=True,user_id='db67c4f0c5944ca193087035b49b4c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Creating volume c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:43:05 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:05 devstack sudo[94677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5 1073741824
Sep 22 15:43:05 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:05 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-ab07d4ee-f77a-4d52-98a2-d834867152c1 req-dfd8de59-0970-4acb-8f7d-fc3f7316acf3 tempest-VolumesSnapshotsTestJSON-556393961 None] Create snapshot completed successfully
Sep 22 15:43:05 devstack sudo[94676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587
Sep 22 15:43:05 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:05 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587" returned: 0 in 0.378s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d314f31-c4b5-4d77-ad02-26dfef6b0a02]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:05 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5 1073741824" returned: 0 in 0.475s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:05 devstack sudo[94687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f
Sep 22 15:43:05 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:05 devstack sudo[94689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5
Sep 22 15:43:05 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:06 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" returned: 0 in 0.373s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:06 devstack sudo[94695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587
Sep 22 15:43:06 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:06 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5" returned: 0 in 0.266s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5049e8d-f4d0-4404-81b7-3a3c86acdcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643af685-72af-4339-8950-c6ad6ce5a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:06 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Volume volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5 (c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5): created successfully
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643af685-72af-4339-8950-c6ad6ce5a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Flow 'volume_create_manager' (b876b387-fa10-400e-844f-df47cdef3438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ffe5ea6a-4948-44e8-8b52-254d5106e3a8 tempest-VolumesTransfersTest-1632774848 None] Created volume successfully.
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Acquiring lock "cinder-00e66d56-cac1-4724-8b67-e8b92b48d272-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-00e66d56-cac1-4724-8b67-e8b92b48d272-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Acquiring lock "cinder-quobyte-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-quobyte-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Acquiring lock "cinder-quobyte-00e66d56-cac1-4724-8b67-e8b92b48d272" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-quobyte-00e66d56-cac1-4724-8b67-e8b92b48d272" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Deleting offline snapshot 00e66d56-cac1-4724-8b67-e8b92b48d272 of volume 74e7156d-7ddb-4d70-b8fa-e44702c1cebe {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] snapshot_file for this snap is: volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ebdb4b-3382-46bc-b4cf-fa492c735a81]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:06 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587" returned: 0 in 0.371s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:06 devstack sudo[94703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587
Sep 22 15:43:06 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:06 devstack sudo[94701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272
Sep 22 15:43:06 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:06 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f.b6ef1fa6-0f7d-46b4-a708-16d28517c587" returned: 0 in 0.253s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-b6ef1fa6-0f7d-46b4-a708-16d28517c587" released by "_delete_snapshot" :: held 1.485s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" released by "delete_snapshot" :: held 1.512s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=121,cinder:UPDATE=126,cinder:INSERT=29,cinder:DELETE=7 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:43:06 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272" returned: 0 in 0.404s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[064fe4ae-e31a-4435-8c0e-f490198e9f4f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:06 devstack cinder-volume[85987]: WARNING cinder.quota [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-958789640 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-958789640, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:43:06 devstack cinder-volume[85987]: WARNING cinder.quota [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-958789640 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-958789640, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:43:06 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Created reservations ['960ffbea-8d0e-41ea-b15c-bb96d46407e7', '975a7349-319f-44dd-b6a1-bcdc2f8ccb86', '9cfb58f5-394c-48ae-beff-fba3f37eb258', '61dd9209-a5bf-43df-bfb6-ba4675dc6b16'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:07 devstack sudo[94710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe
Sep 22 15:43:07 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:07 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=124,cinder:SELECT=126,cinder:INSERT=31,cinder:DELETE=7 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:43:07 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] Created reservations ['6fc64d2b-a0dc-41cb-bb0a-ffc87d10b779', '470ec5c7-1cf5-4b02-b539-92eb073a98b5', '02e249d6-135e-4738-84a1-b20be0feedcd', 'ca124eca-74d2-4f5d-91b4-5e1ef37d1c7c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:07 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-85d1eb2d-4a32-4527-b359-be5bab6bfed9 tempest-GroupSnapshotsTest-466544103 None] group_snapshot d6076619-8bd1-4e44-83e7-e9f9b983acbd: deleted successfully
Sep 22 15:43:07 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" returned: 0 in 0.459s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:07 devstack sudo[94715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272
Sep 22 15:43:07 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:07 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a86b5ad0-a801-4b48-a725-a8a9ec291c1b tempest-VolumesTransfersTest-636151235 None] Transfer volume completed successfully.
Sep 22 15:43:07 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272" returned: 0 in 0.402s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:07 devstack sudo[94721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272
Sep 22 15:43:07 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:08 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe.00e66d56-cac1-4724-8b67-e8b92b48d272" returned: 0 in 0.303s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-quobyte-00e66d56-cac1-4724-8b67-e8b92b48d272" released by "_delete_snapshot" :: held 1.729s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-quobyte-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" released by "delete_snapshot" :: held 1.758s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.quota [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Created reservations ['c95108f9-b23b-492b-b6e5-8d50ff997a25', 'cf98e5d6-80c8-4e41-8b30-9dfbbbe52ee0', '55a8037b-5f7b-4169-9c99-797cc70dfd16', '1fec58c5-0c20-47d5-9799-30cfd65a14f4'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:08 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Delete snapshot completed successfully.
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-db56bb98-2e2c-4eb0-802a-2374bcf1c936 req-564a7a25-e92c-4155-b999-295c56a7fc4c tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-00e66d56-cac1-4724-8b67-e8b92b48d272-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Acquiring lock "cinder-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Lock "cinder-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Acquiring lock "cinder-quobyte-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Lock "cinder-quobyte-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[03565738-5a9b-4d4c-b7ac-f96e89f68ba0]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Acquiring lock "cinder-74e7156d-7ddb-4d70-b8fa-e44702c1cebe-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-75492d5e-b6d8-46e6-b405-76818b0529b4" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:08 devstack sudo[94724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5
Sep 22 15:43:08 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-74e7156d-7ddb-4d70-b8fa-e44702c1cebe-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-75492d5e-b6d8-46e6-b405-76818b0529b4" acquired by "delete_volume" :: waited 0.037s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a3ac5-55da-4b54-b9a1-3fd152e2cea3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Acquiring lock "cinder-quobyte-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-quobyte-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd856d2-b4d5-4a4e-9276-099b20f9fc46]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:09 devstack sudo[94726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4
Sep 22 15:43:09 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:09 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5" returned: 0 in 0.607s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:09 devstack sudo[94727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe
Sep 22 15:43:09 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:09 devstack sudo[94734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5
Sep 22 15:43:09 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:09 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4" returned: 0 in 0.541s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:09 devstack sudo[94743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4
Sep 22 15:43:09 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:09 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5" returned: 0 in 0.367s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Lock "cinder-quobyte-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5" released by "delete_volume" :: held 1.053s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:09 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" returned: 0 in 0.536s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:09 devstack sudo[94746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe
Sep 22 15:43:09 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Created reservations ['3ea86a0c-a17f-4f24-9d4b-67316c51c00f', '1cb3490a-8d5e-4bc5-9ae6-af3c83e496c9', '7699c72f-1557-48e5-939f-f01878e9e874', '67514ffb-ce0b-442c-ae86-80699aecd747'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:09 devstack sudo[94749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:09 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:09 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-75492d5e-b6d8-46e6-b405-76818b0529b4" returned: 0 in 0.348s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-75492d5e-b6d8-46e6-b405-76818b0529b4" released by "delete_volume" :: held 1.030s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" acquired by "delete_volume" :: waited 0.039s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:09 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" returned: 0 in 0.422s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1716fc-a377-41cd-aab6-895be1347035]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-quobyte-74e7156d-7ddb-4d70-b8fa-e44702c1cebe" released by "delete_volume" :: held 1.072s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:10 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.355s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Deleted volume successfully.
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4fbd12da-30bd-4ebf-bf0c-4d471697b3eb tempest-VolumesTransfersTest-330558182 None] Lock "cinder-c2bfaa6a-7e0a-4e75-8243-1fc906efa4e5-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG cinder.quota [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Created reservations ['d326c095-9205-4d50-a65f-daeed47dcc8b', 'a20e257a-6657-4f83-b0ec-845a7ff8f773', 'e6fb2d10-26f2-4371-b92a-4a0b587f6e48', '23d2e516-f691-43c7-af21-1e343c2641ef'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:10 devstack sudo[94755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f
Sep 22 15:43:10 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:10 devstack sudo[94776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:10 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:10 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" returned: 0 in 0.679s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:10 devstack sudo[94782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f
Sep 22 15:43:10 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:10 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.395s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG cinder.manager [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Deleted volume successfully.
Sep 22 15:43:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-ec4c4b14-9625-4f3f-8507-6c91480e18aa req-c23324ea-6abd-45ce-bad7-5ce6df73a6e0 tempest-VolumesSnapshotsTestJSON-556393961 None] Lock "cinder-74e7156d-7ddb-4d70-b8fa-e44702c1cebe-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:11 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" returned: 0 in 0.347s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-9c99840a-cfc5-4ad4-94bc-38591e51aa8f" released by "delete_volume" :: held 1.155s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Created reservations ['82a5db38-f864-4035-9b64-8e79d34496be'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:11 devstack cinder-volume[85987]: WARNING cinder.quota [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-958789640 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-958789640, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Created reservations ['cefd399f-3d43-4d14-b019-a00d58f35394', '09d46f28-8f6f-4104-a305-3bb8a97ba996', '5b2368d1-12c0-44b5-9228-600b24a39486', 'c8830af7-1117-429f-a6fc-86283aa0708e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Created reservations ['d9d54f5a-5ec0-422f-8cd8-c14a9addf887', '6be946fe-8897-40c6-b0f1-908b86be8fb3', '5f22d894-d0e4-43ef-9cef-017943504731', 'f7a1a92f-d36a-466e-b8aa-a826c1066718'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Flow 'volume_create_manager' (ef373c79-c96c-4fb1-8941-d6104d0325d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b4b752-b1f0-4a74-9b56-54a6466608cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b4b752-b1f0-4a74-9b56-54a6466608cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1512566102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae4947e-7ce2-4e31-b523-def8d5034b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86236f0e587486e8bf9aef06f6ada95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:11Z,use_quota=True,user_id='db67c4f0c5944ca193087035b49b4c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9889ea-4aaa-48d4-8452-74ca3f188999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9889ea-4aaa-48d4-8452-74ca3f188999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be078af-f34e-42bc-872e-16c6b78e8b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be078af-f34e-42bc-872e-16c6b78e8b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae4947e-7ce2-4e31-b523-def8d5034b10', 'volume_name': 'volume-2ae4947e-7ce2-4e31-b523-def8d5034b10', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42601e37-fdc8-45b9-b28e-4337598f6f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42601e37-fdc8-45b9-b28e-4337598f6f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b6d95b-73e5-4d5a-bd39-02469d901a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:11 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Volume 2ae4947e-7ce2-4e31-b523-def8d5034b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae4947e-7ce2-4e31-b523-def8d5034b10', 'volume_size': 1}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1512566102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae4947e-7ce2-4e31-b523-def8d5034b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86236f0e587486e8bf9aef06f6ada95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:11Z,use_quota=True,user_id='db67c4f0c5944ca193087035b49b4c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Creating volume 2ae4947e-7ce2-4e31-b523-def8d5034b10 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:43:11 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:11 devstack sudo[94787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10 1073741824
Sep 22 15:43:11 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:11 devstack sudo[94789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:11 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:12 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.332s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:12 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-952012ba-667e-4016-aea7-55d3fc1e2b9c tempest-GroupSnapshotsTest-466544103 None] Delete group completed successfully.
Sep 22 15:43:12 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10 1073741824" returned: 0 in 0.594s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:12 devstack sudo[94797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10
Sep 22 15:43:12 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:12 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10" returned: 0 in 0.344s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b6d95b-73e5-4d5a-bd39-02469d901a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae4947e-7ce2-4e31-b523-def8d5034b10', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c560a41-8493-4a28-836c-86dfb2f846a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:12 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Volume volume-2ae4947e-7ce2-4e31-b523-def8d5034b10 (2ae4947e-7ce2-4e31-b523-def8d5034b10): created successfully
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c560a41-8493-4a28-836c-86dfb2f846a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Flow 'volume_create_manager' (ef373c79-c96c-4fb1-8941-d6104d0325d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:12 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-674dead4-9362-4b64-b1ba-af1679c55011 tempest-VolumesTransfersTest-1632774848 None] Created volume successfully.
Sep 22 15:43:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1fc5abea-afad-44c4-9e9b-4d8b8ac5bb1d tempest-GroupSnapshotsTest-466544103 None] Group tempest-GroupSnapshotsTest-Group-1589437930: creating
Sep 22 15:43:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1fc5abea-afad-44c4-9e9b-4d8b8ac5bb1d tempest-GroupSnapshotsTest-466544103 None] Group tempest-GroupSnapshotsTest-Group-1589437930: created successfully
Sep 22 15:43:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1fc5abea-afad-44c4-9e9b-4d8b8ac5bb1d tempest-GroupSnapshotsTest-466544103 None] Create group completed successfully.
Sep 22 15:43:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Acquiring lock "cinder-2ae4947e-7ce2-4e31-b523-def8d5034b10-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Lock "cinder-2ae4947e-7ce2-4e31-b523-def8d5034b10-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Acquiring lock "cinder-quobyte-2ae4947e-7ce2-4e31-b523-def8d5034b10" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Lock "cinder-quobyte-2ae4947e-7ce2-4e31-b523-def8d5034b10" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:14 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ddfde1-79f2-4d89-954e-520bdc6cea35]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:14 devstack sudo[94801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10
Sep 22 15:43:14 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:14 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10" returned: 0 in 0.506s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:14 devstack sudo[94806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10
Sep 22 15:43:14 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:15 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2ae4947e-7ce2-4e31-b523-def8d5034b10" returned: 0 in 0.354s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Lock "cinder-quobyte-2ae4947e-7ce2-4e31-b523-def8d5034b10" released by "delete_volume" :: held 0.931s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Created reservations ['d9c81359-4821-470b-9a26-52b2bee865aa', '68891d5d-136d-4e23-b8b9-15194070b618', 'aaa8d0c6-9a20-4b6c-a4b0-197dfb628cca', '971f32f6-9159-4118-9edd-47bebefe1fa4'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Flow 'volume_create_manager' (d0d43076-5470-48a7-9cc5-0e1dc9aa3c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2820b750-b255-4446-91b0-69df74906764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2820b750-b255-4446-91b0-69df74906764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700295649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=01ebc2bc-82d3-4713-89b3-94a2f676d9e4,host='devstack@QuobyteHD#QuobyteHD',id=c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e3fe4eea5c4605b09a183d4de72ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:15Z,use_quota=True,user_id='97bf972fd42c431ebdde778e0ca95727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b25c2d97-58f1-4178-866a-2b1e331efb0d),volume_type_id=b25c2d97-58f1-4178-866a-2b1e331efb0d)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795aa026-92bd-445a-8994-6433136b13ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795aa026-92bd-445a-8994-6433136b13ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e67b69-dc87-4dfc-aebd-64dbad6627f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e67b69-dc87-4dfc-aebd-64dbad6627f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7', 'volume_name': 'volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c401fe50-b888-45dc-ba41-500bed65a9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c401fe50-b888-45dc-ba41-500bed65a9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5466ae-baf0-444e-9f96-7a7aba6f0e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:15 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Volume c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7', 'volume_size': 1}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=01ebc2bc-82d3-4713-89b3-94a2f676d9e4,created_at=2026-09-22T13:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700295649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=01ebc2bc-82d3-4713-89b3-94a2f676d9e4,host='devstack@QuobyteHD#QuobyteHD',id=c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e3fe4eea5c4605b09a183d4de72ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:15Z,use_quota=True,user_id='97bf972fd42c431ebdde778e0ca95727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b25c2d97-58f1-4178-866a-2b1e331efb0d),volume_type_id=b25c2d97-58f1-4178-866a-2b1e331efb0d)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Creating volume c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:43:15 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:15 devstack sudo[94809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 1073741824
Sep 22 15:43:15 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:15 devstack sudo[94811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:15 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:15 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.326s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Deleted volume successfully.
Sep 22 15:43:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1766fe9a-048c-49d2-ba03-91e507976c74 tempest-VolumesTransfersTest-330558182 None] Lock "cinder-2ae4947e-7ce2-4e31-b523-def8d5034b10-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:16 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 1073741824" returned: 0 in 0.643s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:16 devstack sudo[94818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7
Sep 22 15:43:16 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:16 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" returned: 0 in 0.326s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5466ae-baf0-444e-9f96-7a7aba6f0e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09430116-0324-453d-8624-20b15021b95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:16 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Volume volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 (c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7): created successfully
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09430116-0324-453d-8624-20b15021b95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Flow 'volume_create_manager' (d0d43076-5470-48a7-9cc5-0e1dc9aa3c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5433246c-256f-4c95-8a30-4db761801465 tempest-GroupSnapshotsTest-466544103 None] Created volume successfully.
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Flow 'volume_create_manager' (17657a43-1781-4f9b-82a2-80a3ab3dd265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4411dd2-aec6-44bf-93b8-facf82ba86b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4411dd2-aec6-44bf-93b8-facf82ba86b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-222190183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4ce738-b1fc-48f9-a9fc-6325101ba64e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10f4da5e694d4265961b31607ddfe0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:17Z,use_quota=True,user_id='4f196fca9f584cd7a5f9caab369673ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8f9635-b296-45b4-bfbd-dcf93f7183f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8f9635-b296-45b4-bfbd-dcf93f7183f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce42ccc-8fc3-43d8-b0e5-b8862cf8c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce42ccc-8fc3-43d8-b0e5-b8862cf8c516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4ce738-b1fc-48f9-a9fc-6325101ba64e', 'volume_name': 'volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2be3508-5c75-42ae-a7b6-c3922214acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2be3508-5c75-42ae-a7b6-c3922214acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a518602-7323-4ec4-8d10-f774a38773f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:16 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Volume 4b4ce738-b1fc-48f9-a9fc-6325101ba64e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e', 'volume_size': 1}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-222190183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4ce738-b1fc-48f9-a9fc-6325101ba64e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10f4da5e694d4265961b31607ddfe0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:17Z,use_quota=True,user_id='4f196fca9f584cd7a5f9caab369673ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Creating volume 4b4ce738-b1fc-48f9-a9fc-6325101ba64e {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:43:16 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:43:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:16 devstack sudo[94821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e 1073741824
Sep 22 15:43:16 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:17 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e 1073741824" returned: 0 in 0.570s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:17 devstack sudo[94827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e
Sep 22 15:43:17 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:17 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:43:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a518602-7323-4ec4-8d10-f774a38773f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdcd3ac-5bee-4635-be49-a61f1fb63d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:17 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Volume volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e (4b4ce738-b1fc-48f9-a9fc-6325101ba64e): created successfully
Sep 22 15:43:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdcd3ac-5bee-4635-be49-a61f1fb63d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Flow 'volume_create_manager' (17657a43-1781-4f9b-82a2-80a3ab3dd265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-4484ae40-efde-4297-8dfb-b23bf798d72b req-4add0bdb-0f17-4b48-aa4d-0828d8041145 tempest-VolumesGetTestJSON-422274473 None] Created volume successfully.
Sep 22 15:43:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] GroupSnapshot 37b2040c-6e55-4b7c-9575-765e0e435362: creating.
Sep 22 15:43:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Group snapshot 37b2040c-6e55-4b7c-9575-765e0e435362: creating. {{(pid=85987) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 22 15:43:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Creating offline snapshot b2f46baf-5d94-4ba3-bc9a-77b3eb25977b of volume c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:43:18 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f41d488-1513-4054-8f6f-d7c9e5ae8abb]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:18 devstack sudo[94830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7
Sep 22 15:43:18 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:18 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" returned: 0 in 0.443s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:18 devstack sudo[94836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b 1G
Sep 22 15:43:18 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:19 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b 1G" returned: 0 in 0.545s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:19 devstack sudo[94845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b
Sep 22 15:43:19 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:19 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b" returned: 0 in 0.439s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:19 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:19 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b
Sep 22 15:43:19 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Acquiring lock "cinder-4b4ce738-b1fc-48f9-a9fc-6325101ba64e-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Lock "cinder-4b4ce738-b1fc-48f9-a9fc-6325101ba64e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Acquiring lock "cinder-quobyte-4b4ce738-b1fc-48f9-a9fc-6325101ba64e" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Lock "cinder-quobyte-4b4ce738-b1fc-48f9-a9fc-6325101ba64e" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a97d488-2ae1-4e4a-b3ac-979e33ba18f3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:19 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b" returned: 0 in 0.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:19 devstack sudo[94853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e
Sep 22 15:43:19 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:20 devstack sudo[94856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.info
Sep 22 15:43:20 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:20 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e" returned: 0 in 0.501s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:20 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.info" returned: 0 in 0.368s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:20 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:20 devstack sudo[94862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e
Sep 22 15:43:20 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:20 devstack sudo[94863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.info
Sep 22 15:43:20 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:20 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4b4ce738-b1fc-48f9-a9fc-6325101ba64e" returned: 0 in 0.367s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Lock "cinder-quobyte-4b4ce738-b1fc-48f9-a9fc-6325101ba64e" released by "delete_volume" :: held 0.959s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:20 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.info" returned: 0 in 0.380s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:20 devstack cinder-volume[85987]: DEBUG cinder.quota [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Created reservations ['020625ad-4bb1-4557-979e-9ec6c160911a', '0879dcb9-0ccb-4b17-8954-de64a7c969ac', 'baef945d-d576-4aef-a48a-7e36181b92db', '6017c879-f86d-470d-85ba-4513701ae611'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-812a9af0-1734-4e58-8553-82bd3f76f952 tempest-GroupSnapshotsTest-466544103 None] group_snapshot 37b2040c-6e55-4b7c-9575-765e0e435362: created successfully
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:21 devstack sudo[94868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:21 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:21 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.365s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.manager [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Deleted volume successfully.
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-d36ba034-7a32-4c80-8056-4fde0e6929e2 req-4b099e40-5d9b-4a17-866b-3294ee6ec6ce tempest-VolumesGetTestJSON-422274473 None] Lock "cinder-4b4ce738-b1fc-48f9-a9fc-6325101ba64e-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] group_snapshot 37b2040c-6e55-4b7c-9575-765e0e435362: deleting
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] group_snapshot 37b2040c-6e55-4b7c-9575-765e0e435362: deleting {{(pid=85987) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-b2f46baf-5d94-4ba3-bc9a-77b3eb25977b" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-b2f46baf-5d94-4ba3-bc9a-77b3eb25977b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Deleting offline snapshot b2f46baf-5d94-4ba3-bc9a-77b3eb25977b of volume c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] snapshot_file for this snap is: volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98f908b-15c1-4c4e-9dde-179ff80dbac9]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:22 devstack sudo[94893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b
Sep 22 15:43:22 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:22 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b" returned: 0 in 0.612s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:43:22 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6833ca9c-e72e-4b90-9201-ad4ae57c167a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:22 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7
Sep 22 15:43:22 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:23 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" returned: 0 in 0.478s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:23 devstack sudo[94904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b
Sep 22 15:43:23 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:23 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b" returned: 0 in 0.528s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:23 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b
Sep 22 15:43:23 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:24 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7.b2f46baf-5d94-4ba3-bc9a-77b3eb25977b" returned: 0 in 0.392s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-b2f46baf-5d94-4ba3-bc9a-77b3eb25977b" released by "_delete_snapshot" :: held 2.203s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" released by "delete_snapshot" :: held 2.240s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:24 devstack cinder-volume[85987]: WARNING cinder.quota [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-91618455 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-91618455, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:43:24 devstack cinder-volume[85987]: WARNING cinder.quota [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-91618455 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-91618455, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:43:24 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] Created reservations ['138d9274-862c-46a0-b55d-e7e1056b0413', 'b8e8b541-caf7-4783-bc16-f01bed9c33f5', 'f581e38f-4e6b-4d76-b2df-63953ea2bd8d', '1b6af212-c85f-4e88-b151-912e102efe25'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:24 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c31c8c37-955a-4ac4-b56b-0c08d04ae225 tempest-GroupSnapshotsTest-466544103 None] group_snapshot 37b2040c-6e55-4b7c-9575-765e0e435362: deleted successfully
Sep 22 15:43:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "cinder-quobyte-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:26 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9dc3b3-dac4-4cba-b0f3-6f09eb87dbe4]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:26 devstack sudo[94980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7
Sep 22 15:43:26 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:26 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" returned: 0 in 0.715s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:26 devstack sudo[94987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7
Sep 22 15:43:26 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:27 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" returned: 0 in 0.415s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Lock "cinder-quobyte-c49d0a88-c8be-4fd5-bd94-e368ae1ee7e7" released by "delete_volume" :: held 1.280s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Created reservations ['6fa82f38-3b6d-4985-9f2f-17e8eb47d5fc'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:27 devstack cinder-volume[85987]: WARNING cinder.quota [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-91618455 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-91618455, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Created reservations ['618da617-8bbc-46f6-a67a-c44fa74d9da8', '5ec3d02f-eedd-4522-97be-57aba8425f91', '0b4f7211-e199-44b3-954b-d8d68b1fca4f', 'dc8b6caf-6d8d-4d57-8453-88b84ab4991e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:27 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:27 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:28 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.333s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:28 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:28 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5a511e40-02c9-4cf5-b538-e0615b63292c tempest-GroupSnapshotsTest-466544103 None] Delete group completed successfully.
Sep 22 15:43:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:43:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:28 devstack sudo[94993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:28 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:29 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Flow 'volume_create_manager' (c6f315d8-2fa9-4524-bdd1-5f0e93a30f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4bcfc6-d28d-4004-b17e-461b7448c853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.573s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4bcfc6-d28d-4004-b17e-461b7448c853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1089717844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b0c5d4-90ab-4193-ab01-103c27b09e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e74ea1ef7e6482b9642e23652a7e317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:29Z,use_quota=True,user_id='9a4842b16a3b4caebfebf6a827463e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e9fa0d-d5b8-4165-9156-ca44d4d0ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e9fa0d-d5b8-4165-9156-ca44d4d0ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53278ef-0ff3-4f2a-b67a-8bacf46e779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53278ef-0ff3-4f2a-b67a-8bacf46e779b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b0c5d4-90ab-4193-ab01-103c27b09e10', 'volume_name': 'volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65b08da-2890-49c1-bc74-71582ae4c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65b08da-2890-49c1-bc74-71582ae4c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6e228a-d215-42c0-b6f0-e5c08d822c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:29 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Volume c2b0c5d4-90ab-4193-ab01-103c27b09e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10', 'volume_size': 1}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1089717844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b0c5d4-90ab-4193-ab01-103c27b09e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e74ea1ef7e6482b9642e23652a7e317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:29Z,use_quota=True,user_id='9a4842b16a3b4caebfebf6a827463e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Creating volume c2b0c5d4-90ab-4193-ab01-103c27b09e10 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:43:29 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:43:29 devstack sudo[94996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10 1073741824
Sep 22 15:43:29 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e2cb94c3-2d88-4d46-a45a-0850a8012cea tempest-BackendsCapabilitiesAdminTestsJSON-745689919 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5676803588867, 'free_capacity_gb': 1775.5676803588867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85987) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 22 15:43:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61c73c7e-8b59-47d3-a39d-66650aaaf669 tempest-BackendsCapabilitiesAdminTestsJSON-745689919 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5676803588867, 'free_capacity_gb': 1775.5676803588867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85987) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 22 15:43:30 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10 1073741824" returned: 0 in 0.933s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:30 devstack sudo[95004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10
Sep 22 15:43:30 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:30 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10" returned: 0 in 0.518s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:43:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6e228a-d215-42c0-b6f0-e5c08d822c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36b57d4-9e6f-42fd-9458-a9e2ef118f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:30 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Volume volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10 (c2b0c5d4-90ab-4193-ab01-103c27b09e10): created successfully
Sep 22 15:43:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36b57d4-9e6f-42fd-9458-a9e2ef118f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Flow 'volume_create_manager' (c6f315d8-2fa9-4524-bdd1-5f0e93a30f4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:30 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f70e6cc9-1411-4096-95ae-3f320f5107c5 tempest-VolumesTransfersV355Test-1630753415 None] Created volume successfully.
Sep 22 15:43:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-75b31e05-97db-4b6f-8f68-fdf7a6095813 tempest-VolumesTransfersV355Test-1874849222 None] Transfer volume completed successfully.
Sep 22 15:43:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Acquiring lock "cinder-c2b0c5d4-90ab-4193-ab01-103c27b09e10-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Lock "cinder-c2b0c5d4-90ab-4193-ab01-103c27b09e10-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Acquiring lock "cinder-quobyte-c2b0c5d4-90ab-4193-ab01-103c27b09e10" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Lock "cinder-quobyte-c2b0c5d4-90ab-4193-ab01-103c27b09e10" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:33 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[acac42c3-7657-4eda-89f1-93994be92e7e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:34 devstack sudo[95008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10
Sep 22 15:43:34 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:34 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10" returned: 0 in 0.591s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:34 devstack sudo[95013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10
Sep 22 15:43:34 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:34 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c2b0c5d4-90ab-4193-ab01-103c27b09e10" returned: 0 in 0.314s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Lock "cinder-quobyte-c2b0c5d4-90ab-4193-ab01-103c27b09e10" released by "delete_volume" :: held 0.982s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:34 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Created reservations ['4450173f-8e48-4507-a7ab-bf6a68260ea1', '2651901b-7ab1-4100-852c-b2bf57b75cd0', '98a47bf9-2d49-4464-a246-61ab42894ca8', '76de5f19-2d2a-45a1-91fe-7d1141190cba'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:35 devstack sudo[95017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:35 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:35 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.279s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:35 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Deleted volume successfully.
Sep 22 15:43:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dd7f92e8-8b1b-4d7b-b9b1-d6849f6eb6ef tempest-VolumesTransfersV355Test-479150599 None] Lock "cinder-c2b0c5d4-90ab-4193-ab01-103c27b09e10-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Flow 'volume_create_manager' (a3973042-5346-4d47-918c-1220f40219ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc9e6b2-68c5-466a-a738-c9b2664869bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc9e6b2-68c5-466a-a738-c9b2664869bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1730485737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743e521c-430c-4337-92fc-e99a289df8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e74ea1ef7e6482b9642e23652a7e317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:37Z,use_quota=True,user_id='9a4842b16a3b4caebfebf6a827463e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8f2ad1-4dfb-41e1-ad85-0cd74cd20eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8f2ad1-4dfb-41e1-ad85-0cd74cd20eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e12bce-d581-4762-8a24-307db554d62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e12bce-d581-4762-8a24-307db554d62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743e521c-430c-4337-92fc-e99a289df8c2', 'volume_name': 'volume-743e521c-430c-4337-92fc-e99a289df8c2', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20c2552-906c-4ca7-addf-60c24e5867d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20c2552-906c-4ca7-addf-60c24e5867d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9acebb3-0710-4541-abcd-ee37fd014d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Volume 743e521c-430c-4337-92fc-e99a289df8c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743e521c-430c-4337-92fc-e99a289df8c2', 'volume_size': 1}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1730485737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743e521c-430c-4337-92fc-e99a289df8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e74ea1ef7e6482b9642e23652a7e317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:37Z,use_quota=True,user_id='9a4842b16a3b4caebfebf6a827463e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Creating volume 743e521c-430c-4337-92fc-e99a289df8c2 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:43:36 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:43:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:36 devstack sudo[95020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2 1073741824
Sep 22 15:43:36 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:37 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2 1073741824" returned: 0 in 0.618s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:37 devstack sudo[95027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2
Sep 22 15:43:37 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:37 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2" returned: 0 in 0.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:43:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9acebb3-0710-4541-abcd-ee37fd014d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743e521c-430c-4337-92fc-e99a289df8c2', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56edf9f-fabb-47ad-8fc2-e6c140a4d332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:37 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Volume volume-743e521c-430c-4337-92fc-e99a289df8c2 (743e521c-430c-4337-92fc-e99a289df8c2): created successfully
Sep 22 15:43:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56edf9f-fabb-47ad-8fc2-e6c140a4d332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Flow 'volume_create_manager' (a3973042-5346-4d47-918c-1220f40219ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:37 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4ae5eebd-400d-409a-a148-d7505238d06d tempest-VolumesTransfersV355Test-1630753415 None] Created volume successfully.
Sep 22 15:43:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e4f6a29f-2670-444c-93be-b4e8c609f3bc tempest-GroupsV314Test-1704331720 None] Group tempest-GroupsV314Test-Group-2085568443: creating
Sep 22 15:43:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e4f6a29f-2670-444c-93be-b4e8c609f3bc tempest-GroupsV314Test-1704331720 None] Group tempest-GroupsV314Test-Group-2085568443: created successfully
Sep 22 15:43:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e4f6a29f-2670-444c-93be-b4e8c609f3bc tempest-GroupsV314Test-1704331720 None] Create group completed successfully.
Sep 22 15:43:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8c8bdc9e-9610-4a15-af88-c3b7ff23d2cc tempest-GroupSnapshotsV319Test-444146406 None] Group tempest-GroupSnapshotsV319Test-Group-1007047546: creating
Sep 22 15:43:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8c8bdc9e-9610-4a15-af88-c3b7ff23d2cc tempest-GroupSnapshotsV319Test-444146406 None] Group tempest-GroupSnapshotsV319Test-Group-1007047546: created successfully
Sep 22 15:43:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8c8bdc9e-9610-4a15-af88-c3b7ff23d2cc tempest-GroupSnapshotsV319Test-444146406 None] Create group completed successfully.
Sep 22 15:43:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Acquiring lock "cinder-743e521c-430c-4337-92fc-e99a289df8c2-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Lock "cinder-743e521c-430c-4337-92fc-e99a289df8c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Acquiring lock "cinder-quobyte-743e521c-430c-4337-92fc-e99a289df8c2" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Lock "cinder-quobyte-743e521c-430c-4337-92fc-e99a289df8c2" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f1e6cb-b0c6-4c8b-b5ae-2d8646b17bf8]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:39 devstack sudo[95046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2
Sep 22 15:43:39 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:39 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2" returned: 0 in 0.434s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:39 devstack sudo[95062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2
Sep 22 15:43:39 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:39 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-743e521c-430c-4337-92fc-e99a289df8c2" returned: 0 in 0.294s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Lock "cinder-quobyte-743e521c-430c-4337-92fc-e99a289df8c2" released by "delete_volume" :: held 0.784s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Created reservations ['4001fba2-371e-44a2-a6d3-67ea0040ba75', '75634542-f93c-4046-9f2d-381c1bf815ad', '6dd7967a-efaa-4615-a6c6-426aec1597c1', '3b2d899c-3b09-4579-8ad5-5605f3493762'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:40 devstack sudo[95069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:40 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:43:40 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Flow 'volume_create_manager' (f8e253a9-e937-4bef-b7a7-9c632f996a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a33aff-d47f-418e-8af5-1ca109fdeda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.346s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Deleted volume successfully.
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a33aff-d47f-418e-8af5-1ca109fdeda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134687151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=167a2f63-ec29-4251-a60d-bbad32f30bf4,host='devstack@QuobyteHD#QuobyteHD',id=05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e742179b022e435b802e386a13628012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:40Z,use_quota=True,user_id='a055ff0d55b64dd184bcb89702d84d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18912841-05c4-4f2d-93b0-7cc7d995a63f),volume_type_id=18912841-05c4-4f2d-93b0-7cc7d995a63f)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc49862-6cf2-4096-93ce-fb5654f274fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc49862-6cf2-4096-93ce-fb5654f274fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a706cd08-9f75-45da-bfcf-4c804e62078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a706cd08-9f75-45da-bfcf-4c804e62078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da', 'volume_name': 'volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4732b6d0-0a0a-4375-9298-476a4abf5345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4732b6d0-0a0a-4375-9298-476a4abf5345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f5c2df-611f-41f7-97da-c3649645c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Volume 05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da', 'volume_size': 1}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=167a2f63-ec29-4251-a60d-bbad32f30bf4,created_at=2026-09-22T13:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134687151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=167a2f63-ec29-4251-a60d-bbad32f30bf4,host='devstack@QuobyteHD#QuobyteHD',id=05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e742179b022e435b802e386a13628012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:40Z,use_quota=True,user_id='a055ff0d55b64dd184bcb89702d84d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18912841-05c4-4f2d-93b0-7cc7d995a63f),volume_type_id=18912841-05c4-4f2d-93b0-7cc7d995a63f)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Creating volume 05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:43:40 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dffa72ac-e3cd-4421-abb5-02b4d84b7c52 tempest-VolumesTransfersV355Test-479150599 None] Lock "cinder-743e521c-430c-4337-92fc-e99a289df8c2-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:40 devstack sudo[95072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da 1073741824
Sep 22 15:43:40 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Flow 'volume_create_manager' (56d53113-006d-4dbf-9210-781be3a8be26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458d79a5-5c22-4985-af72-2be591542a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458d79a5-5c22-4985-af72-2be591542a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-12990110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4fc807f4-1d21-4773-b6a6-b0fcfa6da11d,host='devstack@QuobyteHD#QuobyteHD',id=f715c919-e50a-4514-9ac9-34b26ecb0cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74540999e25645439d9a2a1a803d400a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:41Z,use_quota=True,user_id='ae91dcc5ba764d84aec1017dade7ab8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01c222ed-08bd-4996-be17-02b50f3163a1),volume_type_id=01c222ed-08bd-4996-be17-02b50f3163a1)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc249d8e-0098-45a5-a18f-a11311c5569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc249d8e-0098-45a5-a18f-a11311c5569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9a8f11-51df-4cb4-a8df-388a750ef8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9a8f11-51df-4cb4-a8df-388a750ef8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f715c919-e50a-4514-9ac9-34b26ecb0cf5', 'volume_name': 'volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ae799a-2518-451f-8c3f-4086567ed331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ae799a-2518-451f-8c3f-4086567ed331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6c23cb-28d4-41b9-8c67-6d383c748ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:40 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Volume f715c919-e50a-4514-9ac9-34b26ecb0cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5', 'volume_size': 1}
Sep 22 15:43:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:41 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da 1073741824" returned: 0 in 0.526s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:41 devstack sudo[95078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da
Sep 22 15:43:41 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:41 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da" returned: 0 in 0.273s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4fc807f4-1d21-4773-b6a6-b0fcfa6da11d,created_at=2026-09-22T13:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-12990110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4fc807f4-1d21-4773-b6a6-b0fcfa6da11d,host='devstack@QuobyteHD#QuobyteHD',id=f715c919-e50a-4514-9ac9-34b26ecb0cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74540999e25645439d9a2a1a803d400a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:41Z,use_quota=True,user_id='ae91dcc5ba764d84aec1017dade7ab8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01c222ed-08bd-4996-be17-02b50f3163a1),volume_type_id=01c222ed-08bd-4996-be17-02b50f3163a1)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Creating volume f715c919-e50a-4514-9ac9-34b26ecb0cf5 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:43:41 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:41 devstack sudo[95081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 1073741824
Sep 22 15:43:41 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f5c2df-611f-41f7-97da-c3649645c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b445f5b9-420e-45ed-93fb-b0525c004dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:41 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Volume volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da (05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da): created successfully
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b445f5b9-420e-45ed-93fb-b0525c004dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Flow 'volume_create_manager' (f8e253a9-e937-4bef-b7a7-9c632f996a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:41 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-020289bf-08e2-4921-8319-0c3d5322e110 tempest-GroupsV314Test-1704331720 None] Created volume successfully.
Sep 22 15:43:42 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 1073741824" returned: 0 in 0.527s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:42 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5
Sep 22 15:43:42 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:42 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5" returned: 0 in 0.328s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6c23cb-28d4-41b9-8c67-6d383c748ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346904ce-1447-4650-8d0b-1d476315d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:42 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Volume volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 (f715c919-e50a-4514-9ac9-34b26ecb0cf5): created successfully
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346904ce-1447-4650-8d0b-1d476315d253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Flow 'volume_create_manager' (56d53113-006d-4dbf-9210-781be3a8be26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c3ab3029-3f86-4801-86cc-44a9a10e374d tempest-GroupSnapshotsV319Test-444146406 None] Created volume successfully.
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:42 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Cloning volume 05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da to volume b440f128-10a2-4719-a640-0fdf901909ab
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Creating offline snapshot 022bde3a-931c-4cfb-a611-afae955ba7dc of volume 05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[3477d323-1e53-4230-8632-6ec3fcd07231]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:42 devstack sudo[95089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da
Sep 22 15:43:42 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:42 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da" returned: 0 in 0.426s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:43 devstack sudo[95094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc 1G
Sep 22 15:43:43 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] GroupSnapshot c60fd1d0-8b4b-4153-ba16-d9d83934f540: creating.
Sep 22 15:43:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Group snapshot c60fd1d0-8b4b-4153-ba16-d9d83934f540: creating. {{(pid=85987) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 22 15:43:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:43 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc 1G" returned: 0 in 0.537s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:43 devstack sudo[95100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc
Sep 22 15:43:43 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:43 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc" returned: 0 in 0.354s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:43 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:43 devstack sudo[95105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc
Sep 22 15:43:43 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:44 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc" returned: 0 in 0.273s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:44 devstack sudo[95108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.info
Sep 22 15:43:44 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:44 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.info" returned: 0 in 0.264s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:44 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:44 devstack sudo[95111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.info
Sep 22 15:43:44 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:44 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.info" returned: 0 in 0.303s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Acquiring lock "cinder-quobyte-b440f128-10a2-4719-a640-0fdf901909ab" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Lock "cinder-quobyte-b440f128-10a2-4719-a640-0fdf901909ab" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] snapshot: 022bde3a-931c-4cfb-a611-afae955ba7dc, volume: b440f128-10a2-4719-a640-0fdf901909ab,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[573d1c44-44d4-43a0-a03f-dcaf57540236]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:44 devstack sudo[95114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc
Sep 22 15:43:44 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:45 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc" returned: 0 in 0.429s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:43:45 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2781e875-e98e-4ac4-9239-e05873f59d05]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:45 devstack sudo[95120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da
Sep 22 15:43:45 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:45 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da" returned: 0 in 0.418s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:43:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:43:45 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:43:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:45 devstack sudo[95125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab
Sep 22 15:43:45 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Flow 'volume_create_manager' (816b2ccc-8a91-436d-a573-0b701dd9d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6fd763-141b-481f-87ff-f4c1dc16df12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6fd763-141b-481f-87ff-f4c1dc16df12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1777037914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf4baf7-7c9d-4175-bde5-77190717bdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b51670c4764c03a9da59200c025900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:51Z,use_quota=True,user_id='72a804ad8bf649218cd0a45c25e00533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582b9268-40d2-44a5-86ba-d5ad4bc7d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582b9268-40d2-44a5-86ba-d5ad4bc7d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466c8e54-53b2-4418-a9ad-a5342e016c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466c8e54-53b2-4418-a9ad-a5342e016c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf4baf7-7c9d-4175-bde5-77190717bdc1', 'volume_name': 'volume-adf4baf7-7c9d-4175-bde5-77190717bdc1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95de2e1c-ad66-4fed-97da-60807857f0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95de2e1c-ad66-4fed-97da-60807857f0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a7e326-6781-40cd-ba7a-eb1ed07143c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:51 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Volume adf4baf7-7c9d-4175-bde5-77190717bdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf4baf7-7c9d-4175-bde5-77190717bdc1', 'volume_size': 1}
Sep 22 15:43:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:53 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab" returned: 0 in 8.008s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:53 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da, size 1024.00 MB, duration 8.01 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:43:53 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Converted 1024.00 MB image at 127.86 MB/s
Sep 22 15:43:53 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:53 devstack sudo[95141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab
Sep 22 15:43:53 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:53 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab" returned: 0 in 0.258s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Lock "cinder-quobyte-b440f128-10a2-4719-a640-0fdf901909ab" released by "_copy_volume_from_snapshot" :: held 9.204s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Acquiring lock "cinder-quobyte-022bde3a-931c-4cfb-a611-afae955ba7dc" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Lock "cinder-quobyte-022bde3a-931c-4cfb-a611-afae955ba7dc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Deleting offline snapshot 022bde3a-931c-4cfb-a611-afae955ba7dc of volume 05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] snapshot_file for this snap is: volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b4b75f-455d-4f8f-b426-4358ec54d8d1]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:54 devstack sudo[95144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc
Sep 22 15:43:54 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:54 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc" returned: 0 in 0.412s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c23d403-c688-4e88-8a48-acd6695fd902]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:54 devstack sudo[95149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da
Sep 22 15:43:54 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:55 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da" returned: 0 in 0.566s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:55 devstack sudo[95154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc
Sep 22 15:43:55 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:55 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc" returned: 0 in 0.410s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:55 devstack sudo[95160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc
Sep 22 15:43:55 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:55 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da.022bde3a-931c-4cfb-a611-afae955ba7dc" returned: 0 in 0.269s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Lock "cinder-quobyte-022bde3a-931c-4cfb-a611-afae955ba7dc" released by "_delete_snapshot" :: held 1.791s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.365s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.401s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Creating offline snapshot e8e9bc80-d9e9-42d1-a969-d58b9703add3 of volume f715c919-e50a-4514-9ac9-34b26ecb0cf5 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a25024c-b86e-4123-906e-6985552b6197]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:56 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b812275f-112f-4b5e-9e09-31fd6613e149 tempest-GroupsV314Test-1704331720 None] Create group from source-group-167a2f63-ec29-4251-a60d-bbad32f30bf4 completed successfully.
Sep 22 15:43:56 devstack sudo[95163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5
Sep 22 15:43:56 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:56 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5" returned: 0 in 0.452s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:56 devstack sudo[95168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 1G
Sep 22 15:43:56 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:56 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 1G" returned: 0 in 0.488s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:56 devstack sudo[95174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3
Sep 22 15:43:56 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:57 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3" returned: 0 in 0.425s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:57 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:57 devstack sudo[95181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3
Sep 22 15:43:57 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:57 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3" returned: 0 in 0.331s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:57 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.info
Sep 22 15:43:57 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Acquiring lock "cinder-quobyte-b440f128-10a2-4719-a640-0fdf901909ab" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:43:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Lock "cinder-quobyte-b440f128-10a2-4719-a640-0fdf901909ab" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:43:57 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9e7bd8-cd35-41e3-b3ec-9ef986927b58]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:43:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:58 devstack sudo[95186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab
Sep 22 15:43:58 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:58 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.info" returned: 0 in 0.403s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:58 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:58 devstack sudo[95189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.info
Sep 22 15:43:58 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:58 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab" returned: 0 in 0.553s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:58 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.info" returned: 0 in 0.371s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:58 devstack sudo[95195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab
Sep 22 15:43:58 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.058s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1777037914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf4baf7-7c9d-4175-bde5-77190717bdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b51670c4764c03a9da59200c025900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:43:51Z,use_quota=True,user_id='72a804ad8bf649218cd0a45c25e00533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Creating volume adf4baf7-7c9d-4175-bde5-77190717bdc1 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:43:58 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:58 devstack sudo[95197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1 1073741824
Sep 22 15:43:58 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c38d475d-2efd-4ed5-9549-879ec96462fe tempest-GroupSnapshotsV319Test-444146406 None] group_snapshot c60fd1d0-8b4b-4153-ba16-d9d83934f540: created successfully
Sep 22 15:43:58 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b440f128-10a2-4719-a640-0fdf901909ab" returned: 0 in 0.362s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Lock "cinder-quobyte-b440f128-10a2-4719-a640-0fdf901909ab" released by "delete_volume" :: held 0.994s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Created reservations ['aeca2054-b900-49a5-9277-d37135423353'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:58 devstack cinder-volume[85987]: WARNING cinder.quota [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1456719634 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1456719634, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:43:58 devstack cinder-volume[85987]: WARNING cinder.quota [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1456719634 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1456719634, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:43:58 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Created reservations ['965d9b34-20d4-4694-8b2f-7738738df905', '7f3b3ee2-1f83-453b-b856-2f127f8d41ea', '71f531cc-bbc4-49ae-8c2a-f58bc6eea94b', '6c5925b9-c679-4fcd-9473-583b209ffc53'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:59 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1 1073741824" returned: 0 in 0.664s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:59 devstack sudo[95204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:43:59 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:43:59 devstack sudo[95206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1
Sep 22 15:43:59 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:43:59 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.293s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:43:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-fe6466d1-1a71-4bf4-a99a-0110cbe99185 tempest-GroupsV314Test-1704331720 None] Delete group completed successfully.
Sep 22 15:43:59 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1" returned: 0 in 0.306s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a7e326-6781-40cd-ba7a-eb1ed07143c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf4baf7-7c9d-4175-bde5-77190717bdc1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fd501e-a8ea-44fd-beed-8a5f06ae72bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:43:59 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Volume volume-adf4baf7-7c9d-4175-bde5-77190717bdc1 (adf4baf7-7c9d-4175-bde5-77190717bdc1): created successfully
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fd501e-a8ea-44fd-beed-8a5f06ae72bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Flow 'volume_create_manager' (816b2ccc-8a91-436d-a573-0b701dd9d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:43:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9565247b-954c-4bdb-8d69-48390597a320 tempest-AttachVolumeTestJSON-266297207 None] Created volume successfully.
Sep 22 15:43:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] group_snapshot c60fd1d0-8b4b-4153-ba16-d9d83934f540: deleting
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] group_snapshot c60fd1d0-8b4b-4153-ba16-d9d83934f540: deleting {{(pid=85987) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 22 15:43:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Acquiring lock "cinder-quobyte-f715c919-e50a-4514-9ac9-34b26ecb0cf5" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Lock "cinder-quobyte-f715c919-e50a-4514-9ac9-34b26ecb0cf5" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Acquiring lock "cinder-quobyte-e8e9bc80-d9e9-42d1-a969-d58b9703add3" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Lock "cinder-quobyte-e8e9bc80-d9e9-42d1-a969-d58b9703add3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Deleting offline snapshot e8e9bc80-d9e9-42d1-a969-d58b9703add3 of volume f715c919-e50a-4514-9ac9-34b26ecb0cf5 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] snapshot_file for this snap is: volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5756d246-a849-4ede-92ec-911479fe0cf7]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:00 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3
Sep 22 15:44:00 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Acquiring lock "cinder-quobyte-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Lock "cinder-quobyte-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da" acquired by "delete_volume" :: waited 0.039s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db89568-0ee7-4cda-8eac-a54e96561af1]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:00 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3" returned: 0 in 0.705s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3bc02c-5c06-4f3e-b0bc-7d2d87048669]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:01 devstack sudo[95219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da
Sep 22 15:44:01 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:01 devstack sudo[95220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5
Sep 22 15:44:01 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-1e1f5308-046c-4518-adde-023533aec93c req-8f64bb92-e2d8-4f31-922d-3106a829fb0f tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-1e1f5308-046c-4518-adde-023533aec93c req-8f64bb92-e2d8-4f31-922d-3106a829fb0f tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-1e1f5308-046c-4518-adde-023533aec93c req-8f64bb92-e2d8-4f31-922d-3106a829fb0f tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:01 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5" returned: 0 in 0.528s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:01 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da" returned: 0 in 0.705s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:01 devstack sudo[95237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3
Sep 22 15:44:01 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-1e1f5308-046c-4518-adde-023533aec93c req-8f64bb92-e2d8-4f31-922d-3106a829fb0f tempest-AttachVolumeTestJSON-266297207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-adf4baf7-7c9d-4175-bde5-77190717bdc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7af98b15-eb86-45d7-9a69-db72098a2097', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:44:01 devstack sudo[95239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da
Sep 22 15:44:01 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:01 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-1e1f5308-046c-4518-adde-023533aec93c req-8f64bb92-e2d8-4f31-922d-3106a829fb0f tempest-AttachVolumeTestJSON-266297207 None] attachment_update completed successfully.
Sep 22 15:44:01 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da" returned: 0 in 0.375s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Lock "cinder-quobyte-05f757c3-89e1-4b6a-b3f6-7c6b7d9ea0da" released by "delete_volume" :: held 1.188s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:01 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3" returned: 0 in 0.516s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:02 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3
Sep 22 15:44:02 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Created reservations ['6eb67c51-9c3e-4d44-9368-1e0170a02bb5'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Created reservations ['0802f7ed-9dac-4328-96bc-3733d8b757d4', '959f37e2-41a6-490d-96e6-52694aa5f16a', 'c5205816-f46e-4b6d-a8cd-7a2784c236a0', '5aed3e2d-9309-441e-b5df-d3fb5c166c40'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:02 devstack sudo[95663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:44:02 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:02 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5.e8e9bc80-d9e9-42d1-a969-d58b9703add3" returned: 0 in 0.428s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Lock "cinder-quobyte-e8e9bc80-d9e9-42d1-a969-d58b9703add3" released by "_delete_snapshot" :: held 2.419s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Lock "cinder-quobyte-f715c919-e50a-4514-9ac9-34b26ecb0cf5" released by "delete_snapshot" :: held 2.450s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:02 devstack cinder-volume[85987]: WARNING cinder.quota [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1156093270 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1156093270, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:44:02 devstack cinder-volume[85987]: WARNING cinder.quota [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1156093270 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1156093270, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] Created reservations ['3a323e6d-520a-4b34-a99e-f1d75e65540d', '386553f5-d7ea-4d2e-a06d-93564d8cccf0', '152a1384-e1d8-47df-8c91-b79a791db613', '4a39f198-4d3a-412b-8dce-c8041e0840e3'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:44:02 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.373s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:02 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:44:02 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b16851a3-e5ed-4669-b93e-340eaf9abe5c tempest-GroupsV314Test-1704331720 None] Delete group completed successfully.
Sep 22 15:44:02 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9c6b7f9d-920a-4bb6-9f08-fcc313bd28cc tempest-GroupSnapshotsV319Test-444146406 None] group_snapshot c60fd1d0-8b4b-4153-ba16-d9d83934f540: deleted successfully
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Flow 'volume_create_manager' (28e3c84d-a23a-4a62-9dfa-a2fbc6c6eb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3318aa-9ec3-43a4-b16c-ac7804689d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3318aa-9ec3-43a4-b16c-ac7804689d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1836235356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320b7a1a-7d47-4692-acf0-c10ffad0c973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf365e7aeeb459f9123ba066db7fed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:03Z,use_quota=True,user_id='b3cd24dcb3e04dce83ef4699661f5566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c177f080-9b15-488d-a507-12505a58637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c177f080-9b15-488d-a507-12505a58637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d16dea-5772-4e7e-a6d8-2cb5049c2b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d16dea-5772-4e7e-a6d8-2cb5049c2b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320b7a1a-7d47-4692-acf0-c10ffad0c973', 'volume_name': 'volume-320b7a1a-7d47-4692-acf0-c10ffad0c973', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176b8e98-b18d-41f4-b9ca-9ea667f46612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176b8e98-b18d-41f4-b9ca-9ea667f46612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47753f2-a822-4537-aa24-9cda92dc9a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:03 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Volume 320b7a1a-7d47-4692-acf0-c10ffad0c973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320b7a1a-7d47-4692-acf0-c10ffad0c973', 'volume_size': 1}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1836235356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320b7a1a-7d47-4692-acf0-c10ffad0c973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf365e7aeeb459f9123ba066db7fed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:03Z,use_quota=True,user_id='b3cd24dcb3e04dce83ef4699661f5566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Creating volume 320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:44:03 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:03 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 1073741824
Sep 22 15:44:03 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Acquiring lock "cinder-quobyte-f715c919-e50a-4514-9ac9-34b26ecb0cf5" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Lock "cinder-quobyte-f715c919-e50a-4514-9ac9-34b26ecb0cf5" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:03 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 1073741824" returned: 0 in 0.685s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[945e8300-347c-4dec-8ef4-caef061e596a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:04 devstack sudo[95673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973
Sep 22 15:44:04 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:04 devstack sudo[95672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5
Sep 22 15:44:04 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Flow 'volume_create_manager' (49208abf-db2a-40a4-9941-67e5702f38cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7045a541-960f-476a-9f0a-e0ee5fe2759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7045a541-960f-476a-9f0a-e0ee5fe2759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1765589255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cba57f8-f45d-487c-a277-fd1c25e49bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b51670c4764c03a9da59200c025900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:04Z,use_quota=True,user_id='72a804ad8bf649218cd0a45c25e00533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6d4bb7-99f8-4c43-ba8d-88f4675fcd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6d4bb7-99f8-4c43-ba8d-88f4675fcd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e40d008-527f-43d3-983d-78f51310f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e40d008-527f-43d3-983d-78f51310f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cba57f8-f45d-487c-a277-fd1c25e49bb6', 'volume_name': 'volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc1e88e-c898-4527-a837-ae3f63e9ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc1e88e-c898-4527-a837-ae3f63e9ffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:04 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3464bdc-e86a-4e8d-bb1c-44dc4ae68eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:04 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Volume 1cba57f8-f45d-487c-a277-fd1c25e49bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6', 'volume_size': 1}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5" returned: 0 in 0.462s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:04 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973" returned: 0 in 0.416s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1765589255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cba57f8-f45d-487c-a277-fd1c25e49bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b51670c4764c03a9da59200c025900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:04Z,use_quota=True,user_id='72a804ad8bf649218cd0a45c25e00533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Creating volume 1cba57f8-f45d-487c-a277-fd1c25e49bb6 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:04 devstack sudo[95687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5
Sep 22 15:44:04 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:44:04 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47753f2-a822-4537-aa24-9cda92dc9a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320b7a1a-7d47-4692-acf0-c10ffad0c973', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:04 devstack sudo[95697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6 1073741824
Sep 22 15:44:04 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274aff2b-f603-417f-9a6f-5b4a108d925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:04 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Volume volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 (320b7a1a-7d47-4692-acf0-c10ffad0c973): created successfully
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274aff2b-f603-417f-9a6f-5b4a108d925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Flow 'volume_create_manager' (28e3c84d-a23a-4a62-9dfa-a2fbc6c6eb25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:44:04 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-14d3836a-21ee-420e-8c44-2f0b82484e1e tempest-VolumesActionsTest-1465302384 None] Created volume successfully.
Sep 22 15:44:04 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f715c919-e50a-4514-9ac9-34b26ecb0cf5" returned: 0 in 0.404s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Lock "cinder-quobyte-f715c919-e50a-4514-9ac9-34b26ecb0cf5" released by "delete_volume" :: held 0.967s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:04 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6 1073741824" returned: 0 in 0.559s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:04 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Created reservations ['04c646d6-48ac-417b-a285-1fe5860d95dc'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:05 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6
Sep 22 15:44:05 devstack cinder-volume[85987]: WARNING cinder.quota [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1156093270 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1156093270, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:44:05 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Created reservations ['ef452f70-6f57-44c8-b53b-27b8b2137ab4', '8cbef614-1f82-4949-9f4b-27ec55c4e8fe', '92b8f1d5-3a47-405d-ba44-3b219b895f9b', '1d06feaa-4f29-453f-a7cf-46a29a4bde7e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:05 devstack sudo[95728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:44:05 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:05 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6" returned: 0 in 0.387s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3464bdc-e86a-4e8d-bb1c-44dc4ae68eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287860c7-5471-4ae0-9d29-83e41f86396c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:05 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Volume volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6 (1cba57f8-f45d-487c-a277-fd1c25e49bb6): created successfully
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287860c7-5471-4ae0-9d29-83e41f86396c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Flow 'volume_create_manager' (49208abf-db2a-40a4-9941-67e5702f38cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:44:05 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-49be4018-3b16-4069-b563-459a3ce794e8 tempest-AttachVolumeTestJSON-266297207 None] Created volume successfully.
Sep 22 15:44:05 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.357s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:05 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:44:05 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-83cfaabb-b59d-4ec4-8ff9-ac0eafbc89b9 tempest-GroupSnapshotsV319Test-444146406 None] Delete group completed successfully.
Sep 22 15:44:07 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=159,cinder:INSERT=34,cinder:UPDATE=191,cinder:DELETE=7 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:44:07 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=149,cinder:INSERT=51,cinder:UPDATE=167,cinder:DELETE=9 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:44:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-c4264a26-a2f8-4618-a22c-95cb85abaf4f req-ad123b46-b68d-4c80-a819-41d2101710fc tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-c4264a26-a2f8-4618-a22c-95cb85abaf4f req-ad123b46-b68d-4c80-a819-41d2101710fc tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-c4264a26-a2f8-4618-a22c-95cb85abaf4f req-ad123b46-b68d-4c80-a819-41d2101710fc tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-c4264a26-a2f8-4618-a22c-95cb85abaf4f req-ad123b46-b68d-4c80-a819-41d2101710fc tempest-AttachVolumeTestJSON-266297207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3aad04e1-b399-4ca4-aca1-a9f1d70b1ace', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:44:07 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-c4264a26-a2f8-4618-a22c-95cb85abaf4f req-ad123b46-b68d-4c80-a819-41d2101710fc tempest-AttachVolumeTestJSON-266297207 None] attachment_update completed successfully.
Sep 22 15:44:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-8c03ddc6-fe41-48e9-80d1-0df836a3e820 req-1cbec2d5-e8fd-4c69-a76e-0717556366e7 tempest-AttachVolumeTestJSON-266297207 None] Terminate volume connection completed successfully.
Sep 22 15:44:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-8c03ddc6-fe41-48e9-80d1-0df836a3e820 req-1cbec2d5-e8fd-4c69-a76e-0717556366e7 tempest-AttachVolumeTestJSON-266297207 None] Deleting attachment 7af98b15-eb86-45d7-9a69-db72098a2097. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:44:12 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-09a64969-c15e-4bbd-b4ce-3a7f7de8f9b1 req-182b1de7-d598-4212-9c4c-9ccc1d569206 tempest-AttachVolumeTestJSON-266297207 None] Terminate volume connection completed successfully.
Sep 22 15:44:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-09a64969-c15e-4bbd-b4ce-3a7f7de8f9b1 req-182b1de7-d598-4212-9c4c-9ccc1d569206 tempest-AttachVolumeTestJSON-266297207 None] Deleting attachment 3aad04e1-b399-4ca4-aca1-a9f1d70b1ace. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:44:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a484b176-6c77-43c7-9b01-ddcc2fc66e44 tempest-VolumesActionsTest-1465302384 None] Acquiring lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973" by "attach_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a484b176-6c77-43c7-9b01-ddcc2fc66e44 tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973" acquired by "attach_volume" :: waited 0.062s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a484b176-6c77-43c7-9b01-ddcc2fc66e44 tempest-VolumesActionsTest-1465302384 None] Attaching volume 320b7a1a-7d47-4692-acf0-c10ffad0c973 to instance 4e942c09-b1db-4b63-a508-fff944294d8d at mountpoint /dev/vdb on host None.
Sep 22 15:44:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a484b176-6c77-43c7-9b01-ddcc2fc66e44 tempest-VolumesActionsTest-1465302384 None] Attach volume completed successfully.
Sep 22 15:44:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a484b176-6c77-43c7-9b01-ddcc2fc66e44 tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973" released by "attach_volume" :: held 0.148s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8fd20536-1d14-4aaf-b9bf-b6ecfd49b66b tempest-VolumesActionsTest-1465302384 None] Acquiring lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973-detach_volume" by "detach_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8fd20536-1d14-4aaf-b9bf-b6ecfd49b66b tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8fd20536-1d14-4aaf-b9bf-b6ecfd49b66b tempest-VolumesActionsTest-1465302384 None] Detaching volume 320b7a1a-7d47-4692-acf0-c10ffad0c973 from instance 4e942c09-b1db-4b63-a508-fff944294d8d.
Sep 22 15:44:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8fd20536-1d14-4aaf-b9bf-b6ecfd49b66b tempest-VolumesActionsTest-1465302384 None] Detach volume completed successfully.
Sep 22 15:44:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8fd20536-1d14-4aaf-b9bf-b6ecfd49b66b tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "cinder-1cba57f8-f45d-487c-a277-fd1c25e49bb6-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-1cba57f8-f45d-487c-a277-fd1c25e49bb6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "cinder-quobyte-1cba57f8-f45d-487c-a277-fd1c25e49bb6" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-quobyte-1cba57f8-f45d-487c-a277-fd1c25e49bb6" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:20 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd8298a-6c2f-4b9a-9cde-d19a0e884e20]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:20 devstack sudo[95912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6
Sep 22 15:44:20 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:21 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6" returned: 0 in 0.497s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:21 devstack sudo[95918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6
Sep 22 15:44:21 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:21 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1cba57f8-f45d-487c-a277-fd1c25e49bb6" returned: 0 in 0.286s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-quobyte-1cba57f8-f45d-487c-a277-fd1c25e49bb6" released by "delete_volume" :: held 0.838s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Created reservations ['22395c96-eb46-429b-80fe-078d44d484d6', '0635870b-e8ec-45c2-b6df-e10660851e8b', '451c8b9a-665b-4d2a-bdad-50ece98272b0', '6a2f11cb-6c1d-4c77-afbd-c570e7c1c23c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:21 devstack sudo[95927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:44:21 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "cinder-adf4baf7-7c9d-4175-bde5-77190717bdc1-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-adf4baf7-7c9d-4175-bde5-77190717bdc1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "cinder-quobyte-adf4baf7-7c9d-4175-bde5-77190717bdc1" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-quobyte-adf4baf7-7c9d-4175-bde5-77190717bdc1" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:22 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919cfe0-167c-44f6-bb5a-91de5b840896]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:22 devstack sudo[95929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1
Sep 22 15:44:22 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:22 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.542s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:22 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:44:22 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Deleted volume successfully.
Sep 22 15:44:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-39f573c7-5cb4-4bd5-a6b1-a92a9b0d55eb tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-1cba57f8-f45d-487c-a277-fd1c25e49bb6-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:22 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1" returned: 0 in 0.553s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:22 devstack sudo[95935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1
Sep 22 15:44:22 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:22 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adf4baf7-7c9d-4175-bde5-77190717bdc1" returned: 0 in 0.291s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-quobyte-adf4baf7-7c9d-4175-bde5-77190717bdc1" released by "delete_volume" :: held 0.945s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Created reservations ['4d797d15-b418-40b4-ac86-0ed90cc1a332', '07999067-4f4b-41c3-8693-9f4e0abe9502', 'a45e5141-a399-4c37-a4df-091fbdafa1db', '2ae8ec25-5fa2-4bda-926a-d08823367567'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:23 devstack sudo[95941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:44:23 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:23 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.346s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:44:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Deleted volume successfully.
Sep 22 15:44:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a6dbf6de-cc0a-4d9b-9715-fa0270e64491 tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-adf4baf7-7c9d-4175-bde5-77190717bdc1-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "cinder-da5d808e-283e-48e8-a8e1-2b87b6771800-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-da5d808e-283e-48e8-a8e1-2b87b6771800-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "cinder-quobyte-da5d808e-283e-48e8-a8e1-2b87b6771800" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-quobyte-da5d808e-283e-48e8-a8e1-2b87b6771800" acquired by "delete_volume" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:24 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2513d1d-a751-4248-88d4-d2571d9883b1]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:24 devstack sudo[95944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800
Sep 22 15:44:24 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:25 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800" returned: 0 in 0.633s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:25 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800
Sep 22 15:44:25 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:25 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da5d808e-283e-48e8-a8e1-2b87b6771800" returned: 0 in 0.436s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-quobyte-da5d808e-283e-48e8-a8e1-2b87b6771800" released by "delete_volume" :: held 1.151s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Created reservations ['39f97347-7197-47d9-bb6b-78a26d671419', '3f7a8f4f-4d83-4b4f-ac0f-2e554fa39d57', '7b6b6748-5aec-420b-91f7-f6e9032589aa', 'e39a1255-a4ec-402f-a5da-9b8492a1bb86'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:25 devstack sudo[95967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:44:25 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:26 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.416s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:26 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:44:26 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Deleted volume successfully.
Sep 22 15:44:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b6fe09b-d505-42be-bec8-30a774ef4c2e tempest-AttachVolumeTestJSON-266297207 None] Lock "cinder-da5d808e-283e-48e8-a8e1-2b87b6771800-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:44:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:28 devstack sudo[95986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:44:28 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:29 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.650s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:44:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:44:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:44:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:44:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8136260-9f0b-46fe-939a-a71b5c22e349 tempest-VolumesActionsTest-1465302384 None] Acquiring lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973" by "attach_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8136260-9f0b-46fe-939a-a71b5c22e349 tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973" acquired by "attach_volume" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a8136260-9f0b-46fe-939a-a71b5c22e349 tempest-VolumesActionsTest-1465302384 None] Attaching volume 320b7a1a-7d47-4692-acf0-c10ffad0c973 to instance 3fb886cf-aa17-4793-8fdc-5ac4f1fd9592 at mountpoint /dev/vdb on host None.
Sep 22 15:44:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a8136260-9f0b-46fe-939a-a71b5c22e349 tempest-VolumesActionsTest-1465302384 None] Attach volume completed successfully.
Sep 22 15:44:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8136260-9f0b-46fe-939a-a71b5c22e349 tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973" released by "attach_volume" :: held 0.134s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8685cf48-105e-4b0e-b00f-1a7b4a0ddb6f tempest-VolumesActionsTest-1465302384 None] Acquiring lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973-detach_volume" by "detach_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8685cf48-105e-4b0e-b00f-1a7b4a0ddb6f tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8685cf48-105e-4b0e-b00f-1a7b4a0ddb6f tempest-VolumesActionsTest-1465302384 None] Detaching volume 320b7a1a-7d47-4692-acf0-c10ffad0c973 from instance 3fb886cf-aa17-4793-8fdc-5ac4f1fd9592.
Sep 22 15:44:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8685cf48-105e-4b0e-b00f-1a7b4a0ddb6f tempest-VolumesActionsTest-1465302384 None] Detach volume completed successfully.
Sep 22 15:44:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8685cf48-105e-4b0e-b00f-1a7b4a0ddb6f tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Flow 'volume_create_manager' (e0708363-1199-4c84-a2d8-efcb7e28137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c4e03a-9d32-4b3d-8897-6024e999693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c4e03a-9d32-4b3d-8897-6024e999693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-96972048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b5a527-93cf-4045-816e-fdb600798faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d593a2956be4a43b47de3d8d91053a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:40Z,use_quota=True,user_id='70ae1039dacb4d5d94b9bce0efe1afba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecaf7fb-fb22-49ca-a58b-44cade668c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecaf7fb-fb22-49ca-a58b-44cade668c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986e4ffd-397b-48eb-aa91-b12f00ceae78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986e4ffd-397b-48eb-aa91-b12f00ceae78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b5a527-93cf-4045-816e-fdb600798faa', 'volume_name': 'volume-90b5a527-93cf-4045-816e-fdb600798faa', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fd5f1f-3a35-4db3-8cb0-46e3744881aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fd5f1f-3a35-4db3-8cb0-46e3744881aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39465c4f-18d3-4fee-a51a-a48d39634529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:40 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Volume 90b5a527-93cf-4045-816e-fdb600798faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b5a527-93cf-4045-816e-fdb600798faa', 'volume_size': 1}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-96972048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b5a527-93cf-4045-816e-fdb600798faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d593a2956be4a43b47de3d8d91053a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:40Z,use_quota=True,user_id='70ae1039dacb4d5d94b9bce0efe1afba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Creating volume 90b5a527-93cf-4045-816e-fdb600798faa {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:44:40 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:44:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:40 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa 1073741824
Sep 22 15:44:40 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:41 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa 1073741824" returned: 0 in 0.519s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:41 devstack sudo[96082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa
Sep 22 15:44:41 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:41 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa" returned: 0 in 0.282s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39465c4f-18d3-4fee-a51a-a48d39634529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b5a527-93cf-4045-816e-fdb600798faa', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644318aa-863a-4874-95d1-397aa02768e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:41 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Volume volume-90b5a527-93cf-4045-816e-fdb600798faa (90b5a527-93cf-4045-816e-fdb600798faa): created successfully
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644318aa-863a-4874-95d1-397aa02768e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Flow 'volume_create_manager' (e0708363-1199-4c84-a2d8-efcb7e28137b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:44:41 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-05a49157-1fe8-4dde-b61e-2e1a98f4306c tempest-VolumesServicesTestJSON-1512170451 None] Created volume successfully.
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ffbf20-176b-4867-90a8-294baed12641]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:41 devstack sudo[96087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973
Sep 22 15:44:41 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Flow 'volume_create_manager' (91bcf00f-3803-4679-a603-3d6167c8db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358c6957-058e-4117-a03c-27aecf820371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358c6957-058e-4117-a03c-27aecf820371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1692577606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b85008c-4aba-4d0d-9c77-dec8cb07d357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3628ec097ddf448490479ea7eb2dc243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:42Z,use_quota=True,user_id='dd744900200c4297ac30f9309d55a26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8d96a6c-0687-412e-a9af-714dc5dc168a),volume_type_id=f8d96a6c-0687-412e-a9af-714dc5dc168a)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7511d3-8333-4e22-b1d8-d6715f2afeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7511d3-8333-4e22-b1d8-d6715f2afeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8171b26a-bb49-49e8-a3c3-0fde5660a48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8171b26a-bb49-49e8-a3c3-0fde5660a48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b85008c-4aba-4d0d-9c77-dec8cb07d357', 'volume_name': 'volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4652e78-88eb-47e9-90ae-17f756c3b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4652e78-88eb-47e9-90ae-17f756c3b47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31388f20-86e1-44cc-80c4-5ffc48aee330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:41 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Volume 5b85008c-4aba-4d0d-9c77-dec8cb07d357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357', 'volume_size': 1}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Acquiring lock "cinder-90b5a527-93cf-4045-816e-fdb600798faa-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Lock "cinder-90b5a527-93cf-4045-816e-fdb600798faa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Acquiring lock "cinder-quobyte-90b5a527-93cf-4045-816e-fdb600798faa" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:44:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Lock "cinder-quobyte-90b5a527-93cf-4045-816e-fdb600798faa" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ddeee0-9544-45fa-bbdb-97dd954ecc70]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:42 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973" returned: 0 in 0.528s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8090b270-28b1-497b-97fc-3a59238411da]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:42 devstack sudo[96092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa
Sep 22 15:44:42 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:42 devstack sudo[96093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973
Sep 22 15:44:42 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:42 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa" returned: 0 in 0.444s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:42 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa
Sep 22 15:44:42 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:42 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973" returned: 0 in 0.459s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.b114c1ea-2cb8-4138-8e54-9630ed3acc0amjcjhn16.img {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:42 devstack sudo[96104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.b114c1ea-2cb8-4138-8e54-9630ed3acc0amjcjhn16.img
Sep 22 15:44:42 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:42 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-90b5a527-93cf-4045-816e-fdb600798faa" returned: 0 in 0.268s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Lock "cinder-quobyte-90b5a527-93cf-4045-816e-fdb600798faa" released by "delete_volume" :: held 0.762s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Created reservations ['cc64f361-4de4-4862-b5c5-1924e77461a5', '2297ef88-042e-4c73-a66c-44a9dbe19f26', '5dd238f2-a3e4-413e-bd47-b490e2231e67', '80945ae4-e71e-4a3d-a136-6bb1b170d437'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:44:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:42 devstack sudo[96116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:44:42 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:43 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.645s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:43 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:44:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Deleted volume successfully.
Sep 22 15:44:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6dbd6be4-297e-4203-bb85-5488fdea0284 tempest-VolumesServicesTestJSON-1512170451 None] Lock "cinder-90b5a527-93cf-4045-816e-fdb600798faa-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:44:51 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.b114c1ea-2cb8-4138-8e54-9630ed3acc0amjcjhn16.img" returned: 0 in 8.578s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[39256dea-dd13-4573-9c03-917520fec414]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:44:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:44:51 devstack sudo[96122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973
Sep 22 15:44:51 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:44:51 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root
Sep 22 15:44:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973" returned: 0 in 0.552s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:44:51 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.b114c1ea-2cb8-4138-8e54-9630ed3acc0amjcjhn16.img {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:44:51 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Converted 1024.00 MB image at 119.35 MB/s
Sep 22 15:44:51 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] b114c1ea-2cb8-4138-8e54-9630ed3acc0a was raw, no need to convert to raw {{(pid=85987) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Flow 'volume_create_manager' (ed567a58-7fb7-4ebf-91c0-a6173acd6d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1b0b5c-41e5-4de8-aba7-d72543ecd400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1b0b5c-41e5-4de8-aba7-d72543ecd400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-397990714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0842a21-5304-4743-8686-2990fcc26127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdb81a4e45b4be4aa2162404a815042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:55Z,use_quota=True,user_id='f1d65a1dcd8a490d8f682adff7af52f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c130ed1-98c5-4851-85b8-30a55ae343eb),volume_type_id=4c130ed1-98c5-4851-85b8-30a55ae343eb)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0bce2a-5c76-4ecb-a4b3-ce5942addc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0bce2a-5c76-4ecb-a4b3-ce5942addc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc69178-348e-430a-8015-1fc927d3a3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc69178-348e-430a-8015-1fc927d3a3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0842a21-5304-4743-8686-2990fcc26127', 'volume_name': 'volume-d0842a21-5304-4743-8686-2990fcc26127', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddc868f-dd94-4e91-af72-c57eda0c485f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddc868f-dd94-4e91-af72-c57eda0c485f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75be2654-e23f-4195-8a74-d99b4429d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:54 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Volume d0842a21-5304-4743-8686-2990fcc26127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0842a21-5304-4743-8686-2990fcc26127', 'volume_size': 1}
Sep 22 15:44:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Flow 'volume_create_manager' (a24e6641-5b20-4d85-a38f-b2b150c8fe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6de5e9-1eda-4f3e-9618-4151c908ce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6de5e9-1eda-4f3e-9618-4151c908ce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-93983445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c02be0-8e62-4a06-864a-acbdb54bcbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c021ad7e7f466696a481078f2e8229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:56Z,use_quota=True,user_id='e5032b706d4f438e956215858cd88f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfb2355-28ab-4e76-a27b-3f145d6834fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfb2355-28ab-4e76-a27b-3f145d6834fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f66c0d-d1ad-4593-b539-12c0b5db0264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f66c0d-d1ad-4593-b539-12c0b5db0264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59c02be0-8e62-4a06-864a-acbdb54bcbb3', 'volume_name': 'volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d70edf-9ea1-40f7-93ef-cc64fef88d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d70edf-9ea1-40f7-93ef-cc64fef88d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33cfbcb-8005-4015-a0d1-c8731b810e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:44:55 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Volume 59c02be0-8e62-4a06-864a-acbdb54bcbb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3', 'volume_size': 1}
Sep 22 15:44:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:05 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=50,cinder:UPDATE=45,cinder:INSERT=10,cinder:DELETE=4 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:45:05 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=44,cinder:UPDATE=43,cinder:INSERT=11,cinder:DELETE=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.281s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Uploaded volume to glance image-id: b114c1ea-2cb8-4138-8e54-9630ed3acc0a. {{(pid=85987) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.927s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1692577606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b85008c-4aba-4d0d-9c77-dec8cb07d357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3628ec097ddf448490479ea7eb2dc243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:42Z,use_quota=True,user_id='dd744900200c4297ac30f9309d55a26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8d96a6c-0687-412e-a9af-714dc5dc168a),volume_type_id=f8d96a6c-0687-412e-a9af-714dc5dc168a)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Creating volume 5b85008c-4aba-4d0d-9c77-dec8cb07d357 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:11 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:11 devstack sudo[96170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357 1073741824
Sep 22 15:45:11 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:11 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9f65dcc8-05fd-468f-80ab-7343ea60f621 tempest-VolumesActionsTest-1465302384 None] Copy volume to image completed successfully.
Sep 22 15:45:12 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357 1073741824" returned: 0 in 0.429s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:12 devstack sudo[96176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357
Sep 22 15:45:12 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:12 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357" returned: 0 in 0.243s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.746s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-397990714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0842a21-5304-4743-8686-2990fcc26127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdb81a4e45b4be4aa2162404a815042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:55Z,use_quota=True,user_id='f1d65a1dcd8a490d8f682adff7af52f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c130ed1-98c5-4851-85b8-30a55ae343eb),volume_type_id=4c130ed1-98c5-4851-85b8-30a55ae343eb)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Creating volume d0842a21-5304-4743-8686-2990fcc26127 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:12 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:12 devstack sudo[96179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127 1073741824
Sep 22 15:45:12 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31388f20-86e1-44cc-80c4-5ffc48aee330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173abc33-015f-4b17-8bbf-e5de3bd7dc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:12 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Volume volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357 (5b85008c-4aba-4d0d-9c77-dec8cb07d357): created successfully
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173abc33-015f-4b17-8bbf-e5de3bd7dc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Flow 'volume_create_manager' (91bcf00f-3803-4679-a603-3d6167c8db72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:12 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-43be5d73-3e64-4059-a3d7-6f69fff3c5c0 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Created volume successfully.
Sep 22 15:45:12 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127 1073741824" returned: 0 in 0.444s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:13 devstack sudo[96185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127
Sep 22 15:45:13 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:13 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127" returned: 0 in 0.284s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.296s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-93983445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c02be0-8e62-4a06-864a-acbdb54bcbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c021ad7e7f466696a481078f2e8229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:44:56Z,use_quota=True,user_id='e5032b706d4f438e956215858cd88f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Creating volume 59c02be0-8e62-4a06-864a-acbdb54bcbb3 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:13 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75be2654-e23f-4195-8a74-d99b4429d20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0842a21-5304-4743-8686-2990fcc26127', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:13 devstack sudo[96188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3 1073741824
Sep 22 15:45:13 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f5b5fa-f05f-4c29-9c7d-5bfca2a84642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Volume volume-d0842a21-5304-4743-8686-2990fcc26127 (d0842a21-5304-4743-8686-2990fcc26127): created successfully
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f5b5fa-f05f-4c29-9c7d-5bfca2a84642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Flow 'volume_create_manager' (ed567a58-7fb7-4ebf-91c0-a6173acd6d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1906379c-14e4-42ae-81b7-0743f0f4dcc0 tempest-VolumeTypesAccessTest-2120918876 None] Created volume successfully.
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bb290d9c-0323-4474-b38a-35ed8fd82498 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bb290d9c-0323-4474-b38a-35ed8fd82498 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bb290d9c-0323-4474-b38a-35ed8fd82498 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bb290d9c-0323-4474-b38a-35ed8fd82498 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bb290d9c-0323-4474-b38a-35ed8fd82498 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bb290d9c-0323-4474-b38a-35ed8fd82498 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:13 devstack sudo[96193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:13 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Acquiring lock "cinder-d0842a21-5304-4743-8686-2990fcc26127-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Lock "cinder-d0842a21-5304-4743-8686-2990fcc26127-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:13 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3 1073741824" returned: 0 in 0.642s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Acquiring lock "cinder-quobyte-d0842a21-5304-4743-8686-2990fcc26127" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Lock "cinder-quobyte-d0842a21-5304-4743-8686-2990fcc26127" acquired by "delete_volume" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:14 devstack sudo[96196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3
Sep 22 15:45:14 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[faac0675-939f-41c8-9672-82ccb6df577c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:14 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bb290d9c-0323-4474-b38a-35ed8fd82498 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.346s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-bb290d9c-0323-4474-b38a-35ed8fd82498 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bb290d9c-0323-4474-b38a-35ed8fd82498 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Retype volume completed successfully.
Sep 22 15:45:14 devstack sudo[96198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127
Sep 22 15:45:14 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:14 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3" returned: 0 in 0.254s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.377s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33cfbcb-8005-4015-a0d1-c8731b810e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bba2344-e1d0-4d12-a33c-3cbcf5b530be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c3abc2-7205-46d1-8753-e9187ee7c933]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:14 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Volume volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3 (59c02be0-8e62-4a06-864a-acbdb54bcbb3): created successfully
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bba2344-e1d0-4d12-a33c-3cbcf5b530be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Flow 'volume_create_manager' (a24e6641-5b20-4d85-a38f-b2b150c8fe03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-647e56f7-5f3f-4a33-94c1-02db321ad457 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Created volume successfully.
Sep 22 15:45:14 devstack sudo[96202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973
Sep 22 15:45:14 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:14 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127" returned: 0 in 0.378s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:14 devstack sudo[96207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127
Sep 22 15:45:14 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:14 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:14 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d0842a21-5304-4743-8686-2990fcc26127" returned: 0 in 0.258s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973" returned: 0 in 0.406s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Lock "cinder-quobyte-d0842a21-5304-4743-8686-2990fcc26127" released by "delete_volume" :: held 0.694s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ded2944-d579-4c05-bead-1bf2c1662e2a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:14 devstack cinder-volume[85987]: WARNING cinder.quota [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-776105501 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-776105501, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:45:14 devstack cinder-volume[85987]: WARNING cinder.quota [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-776105501 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-776105501, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Created reservations ['5f8b6ee4-3ff9-4c88-8395-cc4f8c096c32', 'ccc5b409-3731-4678-8e52-c6ca26526a27', 'ce19c662-052f-4e9f-a7a8-0f523935c012', '0ef3adfc-db73-499a-a076-603c8ed5d85a'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:14 devstack sudo[96214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973
Sep 22 15:45:14 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:14 devstack sudo[96216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:14 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Acquiring lock "cinder-5b85008c-4aba-4d0d-9c77-dec8cb07d357-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "cinder-5b85008c-4aba-4d0d-9c77-dec8cb07d357-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:15 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Acquiring lock "cinder-quobyte-5b85008c-4aba-4d0d-9c77-dec8cb07d357" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Deleted volume successfully.
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Acquiring lock "cinder-59c02be0-8e62-4a06-864a-acbdb54bcbb3-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "cinder-quobyte-5b85008c-4aba-4d0d-9c77-dec8cb07d357" acquired by "delete_volume" :: waited 0.050s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "cinder-59c02be0-8e62-4a06-864a-acbdb54bcbb3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a65d55-4e56-4afb-92a0-a7fb66217a6e tempest-VolumeTypesAccessTest-2120918876 None] Lock "cinder-d0842a21-5304-4743-8686-2990fcc26127-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c128cec-c44b-4e8f-954b-aa4d535bdcf3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Acquiring lock "cinder-quobyte-59c02be0-8e62-4a06-864a-acbdb54bcbb3" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973" returned: 0 in 0.630s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:15 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "cinder-quobyte-59c02be0-8e62-4a06-864a-acbdb54bcbb3" acquired by "delete_volume" :: waited 0.036s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:15 devstack sudo[96223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img
Sep 22 15:45:15 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0854b1f5-2120-4679-9375-9c6391d01a58]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:15 devstack sudo[96222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357
Sep 22 15:45:15 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:15 devstack sudo[96225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3
Sep 22 15:45:15 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:15 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357" returned: 0 in 0.549s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:15 devstack sudo[96241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357
Sep 22 15:45:15 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:16 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3" returned: 0 in 0.684s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:16 devstack sudo[96247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3
Sep 22 15:45:16 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:16 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5b85008c-4aba-4d0d-9c77-dec8cb07d357" returned: 0 in 0.601s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "cinder-quobyte-5b85008c-4aba-4d0d-9c77-dec8cb07d357" released by "delete_volume" :: held 1.229s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:16 devstack cinder-volume[85987]: WARNING cinder.quota [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:45:16 devstack cinder-volume[85987]: WARNING cinder.quota [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Created reservations ['4ca2304d-9839-4be6-89fa-98936e289d37', '6eae26b4-dc08-4ac5-9b63-25262d40da34', '8d37990c-cc8a-41db-b28e-664751107117', '3599a8c1-3c54-4199-9cfd-f2e2465a19eb'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:16 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-59c02be0-8e62-4a06-864a-acbdb54bcbb3" returned: 0 in 0.579s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "cinder-quobyte-59c02be0-8e62-4a06-864a-acbdb54bcbb3" released by "delete_volume" :: held 1.341s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Created reservations ['6d39be67-3be5-447e-a9db-9ef6b21b004d', '8a91e443-0fc5-462b-959e-b9575c613ac4', '66e87965-f4c5-4075-9e62-d5469e2ccd50', 'a2c60310-1649-4f7c-89df-23c8542298a3'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:16 devstack sudo[96251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:16 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:17 devstack sudo[96253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:17 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:17 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.530s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:17 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Deleted volume successfully.
Sep 22 15:45:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5075584-9b2f-48d3-ad96-53411c95ec29 tempest-VolumeRetypeWithoutMigrationTest-434471686 None] Lock "cinder-5b85008c-4aba-4d0d-9c77-dec8cb07d357-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:17 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.721s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:17 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Deleted volume successfully.
Sep 22 15:45:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-63b823f9-8285-4055-af68-3c8fa1e9083e tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "cinder-59c02be0-8e62-4a06-864a-acbdb54bcbb3-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Flow 'volume_create_manager' (92f66fee-9663-4f2b-9248-7211a052b25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c2c548-fd27-4ef7-a3a8-65b24f7df3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c2c548-fd27-4ef7-a3a8-65b24f7df3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-330124856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c45a4ec-876b-4299-95e6-ee73eb9b3e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c021ad7e7f466696a481078f2e8229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:19Z,use_quota=True,user_id='e5032b706d4f438e956215858cd88f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd624269-cbf0-452a-9977-a68b9c8a9546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd624269-cbf0-452a-9977-a68b9c8a9546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18767787-4d1a-4fa2-9fdc-8b6d578ea518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18767787-4d1a-4fa2-9fdc-8b6d578ea518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c45a4ec-876b-4299-95e6-ee73eb9b3e14', 'volume_name': 'volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4ecbbe-4c40-45c5-bcbf-2b19fe02b40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4ecbbe-4c40-45c5-bcbf-2b19fe02b40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7890cdbd-d34b-442d-ab16-5b21150154a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:19 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Volume 4c45a4ec-876b-4299-95e6-ee73eb9b3e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14', 'volume_size': 1}
Sep 22 15:45:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:24 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img" returned: 0 in 8.747s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:24 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5f379b-2457-48c5-be61-619ade506c1f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:24 devstack sudo[96266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973
Sep 22 15:45:24 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:24 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973" returned: 0 in 0.581s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:24 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973, size 1024.00 MB, duration 8.75 sec, destination /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:45:24 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Converted 1024.00 MB image at 117.05 MB/s
Sep 22 15:45:24 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] 8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19c was raw, converting to qcow2 {{(pid=85987) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 22 15:45:24 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad09629-8a90-4b77-9a74-e4dc20b360c3]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:24 devstack sudo[96271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img
Sep 22 15:45:24 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:25 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img" returned: 0 in 0.358s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:25 devstack sudo[96275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img
Sep 22 15:45:25 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:25 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img" returned: 1 in 0.429s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:45:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img /opt/stack/data/cinder/conversion/vol_upload_1aemrjcd {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:25 devstack sudo[96280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img /opt/stack/data/cinder/conversion/vol_upload_1aemrjcd
Sep 22 15:45:25 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:25 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img /opt/stack/data/cinder/conversion/vol_upload_1aemrjcd" returned: 0 in 0.317s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:25 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Image conversion details: src /opt/stack/data/cinder/conversion/320b7a1a-7d47-4692-acf0-c10ffad0c973.temp_image.8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19cl2dxfwte.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1aemrjcd {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:45:25 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 22 15:45:25 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9467d505-8d70-4c7b-a78f-9cc5a1c47a28]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1aemrjcd {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:25 devstack sudo[96286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1aemrjcd
Sep 22 15:45:25 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:26 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1aemrjcd" returned: 0 in 0.359s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.863s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Uploaded volume to glance image-id: 8a5a3dc8-b4fe-4bf1-a9b8-b76f2a00b19c. {{(pid=85987) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.092s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-330124856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c45a4ec-876b-4299-95e6-ee73eb9b3e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c021ad7e7f466696a481078f2e8229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:19Z,use_quota=True,user_id='e5032b706d4f438e956215858cd88f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Creating volume 4c45a4ec-876b-4299-95e6-ee73eb9b3e14 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:28 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:28 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14 1073741824
Sep 22 15:45:28 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:28 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-22ebe725-29f8-4c35-96f4-a33f410d2599 tempest-VolumesActionsTest-1465302384 None] Copy volume to image completed successfully.
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:28 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:28 devstack sudo[96297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14 1073741824" returned: 0 in 0.594s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:28 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:28 devstack sudo[96299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14
Sep 22 15:45:28 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:28 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.327s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:28 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:45:29 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14" returned: 0 in 0.344s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7890cdbd-d34b-442d-ab16-5b21150154a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b88099-d35c-4a4c-b7a2-164c1d44d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:29 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Volume volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14 (4c45a4ec-876b-4299-95e6-ee73eb9b3e14): created successfully
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b88099-d35c-4a4c-b7a2-164c1d44d48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Flow 'volume_create_manager' (92f66fee-9663-4f2b-9248-7211a052b25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ca88fe13-f117-48d5-98cc-bcfe89dfa851 tempest-VolumeQuotasAdminTestJSON-1484138010 None] Created volume successfully.
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Acquiring lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Acquiring lock "cinder-quobyte-320b7a1a-7d47-4692-acf0-c10ffad0c973" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Lock "cinder-quobyte-320b7a1a-7d47-4692-acf0-c10ffad0c973" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5333c9-7ecd-40c2-9b5f-846e1e08843d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:29 devstack sudo[96303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973
Sep 22 15:45:29 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:30 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973" returned: 0 in 0.569s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:30 devstack sudo[96309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973
Sep 22 15:45:30 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:30 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-844f09fb-ec1d-4fe3-a64a-1804f26f2e10 tempest-VolumeQuotasAdminTestJSON-235836920 None] Transfer volume completed successfully.
Sep 22 15:45:30 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-320b7a1a-7d47-4692-acf0-c10ffad0c973" returned: 0 in 0.431s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Lock "cinder-quobyte-320b7a1a-7d47-4692-acf0-c10ffad0c973" released by "delete_volume" :: held 1.078s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:30 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Created reservations ['644e7671-4368-4daa-ac2b-8ea3d6944e92', 'e394f610-5938-4bed-936a-77313a6af9e1', '496658ad-b5d0-41e2-8b69-482b59ee3e60', '6db7df87-3358-43b7-8be2-f11921a86b6f'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:31 devstack sudo[96312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:31 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:31 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.281s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Acquiring lock "cinder-4c45a4ec-876b-4299-95e6-ee73eb9b3e14-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:31 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Deleted volume successfully.
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Lock "cinder-4c45a4ec-876b-4299-95e6-ee73eb9b3e14-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14e957df-ff59-4d7e-9044-4185d7c586ae tempest-VolumesActionsTest-1465302384 None] Lock "cinder-320b7a1a-7d47-4692-acf0-c10ffad0c973-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Acquiring lock "cinder-quobyte-4c45a4ec-876b-4299-95e6-ee73eb9b3e14" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Lock "cinder-quobyte-4c45a4ec-876b-4299-95e6-ee73eb9b3e14" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c8e8d4-e6f5-4907-bb91-de640e5cf776]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:31 devstack sudo[96315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14
Sep 22 15:45:31 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:31 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14" returned: 0 in 0.454s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:31 devstack sudo[96322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14
Sep 22 15:45:31 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:32 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4c45a4ec-876b-4299-95e6-ee73eb9b3e14" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Lock "cinder-quobyte-4c45a4ec-876b-4299-95e6-ee73eb9b3e14" released by "delete_volume" :: held 0.824s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Created reservations ['eb717353-04f7-4c63-8d31-df57da15e123', '9f4bcb72-0d22-4f26-b0c1-52d5410598ff', '40219eae-f2a7-42fa-bf92-03c48626dd85', 'bbf12c21-84a0-4503-b21a-21516fe82762'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:32 devstack sudo[96325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:32 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:32 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.349s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Deleted volume successfully.
Sep 22 15:45:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-75802b1c-824a-4868-87d0-3fa873bb165a tempest-VolumeQuotasAdminTestJSON-44201916 None] Lock "cinder-4c45a4ec-876b-4299-95e6-ee73eb9b3e14-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Flow 'volume_create_manager' (781730c3-f69c-4d87-b9e2-a176b3ad1af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e2a6ab-ab62-4766-8a9a-c8f87088b068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e2a6ab-ab62-4766-8a9a-c8f87088b068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-48458902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760f14e6-78d7-4825-b866-78627faa458b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6226bb7047b4309b225cf0aa1681845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:37Z,use_quota=True,user_id='13d1143d9d5645658f199732ad06b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a7e24e-47c1-49d6-b41c-e49bd2138dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a7e24e-47c1-49d6-b41c-e49bd2138dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b56858-cbb8-45df-9c59-9c25c3804aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b56858-cbb8-45df-9c59-9c25c3804aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760f14e6-78d7-4825-b866-78627faa458b', 'volume_name': 'volume-760f14e6-78d7-4825-b866-78627faa458b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d35bdb9-d445-4c3c-b315-5bbf3b3c9f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d35bdb9-d445-4c3c-b315-5bbf3b3c9f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23c1ed6-f19c-488a-8afd-5a8996f5646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:37 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Volume 760f14e6-78d7-4825-b866-78627faa458b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760f14e6-78d7-4825-b866-78627faa458b', 'volume_size': 1}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-48458902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760f14e6-78d7-4825-b866-78627faa458b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6226bb7047b4309b225cf0aa1681845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:37Z,use_quota=True,user_id='13d1143d9d5645658f199732ad06b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Creating volume 760f14e6-78d7-4825-b866-78627faa458b {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:37 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:37 devstack sudo[96332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b 1073741824
Sep 22 15:45:37 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Flow 'volume_create_manager' (23763a71-0dde-49c4-8435-1b19aa25e29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbfbe96-657f-4262-a92f-93efbb89895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbfbe96-657f-4262-a92f-93efbb89895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1983761376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4d6ba4-3903-43b9-863d-f0be9006eb93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfdc2d6c4e41998df2d45e14b2d9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:38Z,use_quota=True,user_id='9cff31b381324b048266bf95a4553576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e76152-15a1-485c-a6a5-4c5f20d87d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e76152-15a1-485c-a6a5-4c5f20d87d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0b5b63-5afe-42b3-a38b-a9792b250407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0b5b63-5afe-42b3-a38b-a9792b250407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4d6ba4-3903-43b9-863d-f0be9006eb93', 'volume_name': 'volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f453a256-dc9f-4121-84d0-5605cc32ace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f453a256-dc9f-4121-84d0-5605cc32ace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cb3a7b-f8cf-4374-8969-e31110611e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Volume 3f4d6ba4-3903-43b9-863d-f0be9006eb93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93', 'volume_size': 1}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:38 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b 1073741824" returned: 0 in 0.606s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:38 devstack sudo[96340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b
Sep 22 15:45:38 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:38 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b" returned: 0 in 0.319s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1983761376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4d6ba4-3903-43b9-863d-f0be9006eb93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfdc2d6c4e41998df2d45e14b2d9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:38Z,use_quota=True,user_id='9cff31b381324b048266bf95a4553576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Creating volume 3f4d6ba4-3903-43b9-863d-f0be9006eb93 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:38 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23c1ed6-f19c-488a-8afd-5a8996f5646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760f14e6-78d7-4825-b866-78627faa458b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:38 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 1073741824
Sep 22 15:45:38 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefc20d8-c17e-4a27-ac2b-22d9ab779a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Volume volume-760f14e6-78d7-4825-b866-78627faa458b (760f14e6-78d7-4825-b866-78627faa458b): created successfully
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefc20d8-c17e-4a27-ac2b-22d9ab779a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Flow 'volume_create_manager' (781730c3-f69c-4d87-b9e2-a176b3ad1af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-23a7a27d-56eb-4f27-b49a-2d3cd36745f1 tempest-VolumesMetadataTest-983519142 None] Created volume successfully.
Sep 22 15:45:39 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 1073741824" returned: 0 in 0.578s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:39 devstack sudo[96349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93
Sep 22 15:45:39 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:39 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93" returned: 0 in 0.345s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cb3a7b-f8cf-4374-8969-e31110611e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39eb793-1944-47f5-aa13-568fbb87566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:39 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Volume volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 (3f4d6ba4-3903-43b9-863d-f0be9006eb93): created successfully
Sep 22 15:45:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39eb793-1944-47f5-aa13-568fbb87566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Flow 'volume_create_manager' (23763a71-0dde-49c4-8435-1b19aa25e29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f5c6eb64-363a-49c4-b19b-f549b90b3164 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Created volume successfully.
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Creating offline snapshot 2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 of volume 3f4d6ba4-3903-43b9-863d-f0be9006eb93 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba04ef1-a5ab-4151-b7d2-ce31f22fa35b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:40 devstack sudo[96353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93
Sep 22 15:45:40 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Acquiring lock "cinder-760f14e6-78d7-4825-b866-78627faa458b-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Lock "cinder-760f14e6-78d7-4825-b866-78627faa458b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:40 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93" returned: 0 in 0.537s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:40 devstack sudo[96359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 1G
Sep 22 15:45:40 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Acquiring lock "cinder-quobyte-760f14e6-78d7-4825-b866-78627faa458b" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Lock "cinder-quobyte-760f14e6-78d7-4825-b866-78627faa458b" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9766097-cc49-4a26-aeed-75ccdbc91e30]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:41 devstack sudo[96361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b
Sep 22 15:45:41 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:41 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 1G" returned: 0 in 0.516s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:41 devstack sudo[96368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8
Sep 22 15:45:41 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:41 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b" returned: 0 in 0.569s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:41 devstack sudo[96373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b
Sep 22 15:45:41 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:41 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8" returned: 0 in 0.428s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:41 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 is being set with open permissions: ugo+rw
Sep 22 15:45:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:41 devstack sudo[96379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8
Sep 22 15:45:41 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:41 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-760f14e6-78d7-4825-b866-78627faa458b" returned: 0 in 0.433s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Lock "cinder-quobyte-760f14e6-78d7-4825-b866-78627faa458b" released by "delete_volume" :: held 1.073s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Created reservations ['a17e3770-cbb1-401a-972a-44e919e0e09c', '240c7d6f-8c25-4e45-8388-65837fd261a1', 'd65653b6-18ff-4766-88e9-be4d3c00d5b2', '18bee234-da2f-4b91-9dbd-dcfc27f3bceb'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:42 devstack sudo[96382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:42 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:42 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8" returned: 0 in 0.555s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:42 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.info
Sep 22 15:45:42 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:42 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.409s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Deleted volume successfully.
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bebe95d9-9447-4cf8-af14-d6066c53370f tempest-VolumesMetadataTest-983519142 None] Lock "cinder-760f14e6-78d7-4825-b866-78627faa458b-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:42 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.info" returned: 0 in 0.461s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:42 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.info is being set with open permissions: ugo+rw
Sep 22 15:45:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:42 devstack sudo[96389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.info
Sep 22 15:45:42 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Flow 'volume_create_manager' (67732491-68e9-49ef-9625-efce2d7fbf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d59ba2-2f14-4c74-bd93-9e3f51375d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d59ba2-2f14-4c74-bd93-9e3f51375d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2133190499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3100f0e59c5478d93acc703b1a19b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:43Z,use_quota=True,user_id='e5ccf8ede7fe43ab8cc7eee6c7336a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96757f5d-4c02-4316-876d-86c555b3b2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96757f5d-4c02-4316-876d-86c555b3b2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8118e1-37f1-42a1-877c-886684347af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8118e1-37f1-42a1-877c-886684347af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1', 'volume_name': 'volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1', 'volume_size': 2}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb590dd-cf23-48f8-bcaf-1dfd1c158670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb590dd-cf23-48f8-bcaf-1dfd1c158670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9a3d26-3f46-41be-9297-cae626446466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Volume 4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1', 'volume_size': 2}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:43 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.info" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.956s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2133190499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3100f0e59c5478d93acc703b1a19b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:43Z,use_quota=True,user_id='e5ccf8ede7fe43ab8cc7eee6c7336a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Creating volume 4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:43 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 2147483648 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:43 devstack sudo[96392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 2147483648
Sep 22 15:45:43 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-112e6258-fbee-465f-8d86-cde48218b165 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Create snapshot completed successfully
Sep 22 15:45:43 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 2147483648" returned: 0 in 0.722s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:44 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1
Sep 22 15:45:44 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Acquiring lock "cinder-2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Acquiring lock "cinder-quobyte-3f4d6ba4-3903-43b9-863d-f0be9006eb93" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-quobyte-3f4d6ba4-3903-43b9-863d-f0be9006eb93" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Acquiring lock "cinder-quobyte-2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-quobyte-2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Deleting offline snapshot 2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 of volume 3f4d6ba4-3903-43b9-863d-f0be9006eb93 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] snapshot_file for this snap is: volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d819b3-13f9-41bd-ad6d-e4ad3f40c848]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:44 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" returned: 0 in 0.331s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9a3d26-3f46-41be-9297-cae626446466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1', 'volume_size': 2}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61df6d99-b795-4b7a-a694-b9b329e381c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:44 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Volume volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 (4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1): created successfully
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61df6d99-b795-4b7a-a694-b9b329e381c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Flow 'volume_create_manager' (67732491-68e9-49ef-9625-efce2d7fbf2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:44 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b2e2f38f-8634-4820-a76e-5d4f67dba336 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Created volume successfully.
Sep 22 15:45:44 devstack sudo[96401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8
Sep 22 15:45:44 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:44 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8" returned: 0 in 0.480s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51ccff7-f65a-4d0c-9ae9-af6c97ce5f11]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:44 devstack sudo[96406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93
Sep 22 15:45:44 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:45 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93" returned: 0 in 0.479s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:45 devstack sudo[96411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8
Sep 22 15:45:45 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Creating offline snapshot 0cb3f975-95ff-4292-8121-aac5a8f25a7b of volume 4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:45:45 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[98305d03-9e90-4316-a3c2-1fb9c2243bc6]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:45 devstack sudo[96413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1
Sep 22 15:45:45 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:45 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8" returned: 0 in 0.485s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:45 devstack sudo[96418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8
Sep 22 15:45:45 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:46 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" returned: 0 in 0.484s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b 2G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:46 devstack sudo[96424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b 2G
Sep 22 15:45:46 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:46 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93.2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8" returned: 0 in 0.348s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-quobyte-2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8" released by "_delete_snapshot" :: held 1.952s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-quobyte-3f4d6ba4-3903-43b9-863d-f0be9006eb93" released by "delete_snapshot" :: held 1.986s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:46 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Created reservations ['d4ee74f1-7fab-4b73-865a-6459564d8437', 'e7e17d4a-f1d3-44b2-b364-da230692b157', '8686b68c-24a0-4dfa-8855-6117e75f88f9', 'bd07d053-7964-43b7-b8ec-dab59cdbed2e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Delete snapshot completed successfully.
Sep 22 15:45:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8972d45-a473-46f7-a6f8-152a3bcdc78c tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-2b92a2fb-5ef6-40ea-bb69-0e7b7f3f2aa8-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:46 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b 2G" returned: 0 in 0.641s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:46 devstack sudo[96431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b
Sep 22 15:45:46 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:47 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b" returned: 0 in 0.343s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:47 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b is being set with open permissions: ugo+rw
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:47 devstack sudo[96437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b
Sep 22 15:45:47 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:47 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b" returned: 0 in 0.286s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:47 devstack sudo[96440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.info
Sep 22 15:45:47 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Acquiring lock "cinder-3f4d6ba4-3903-43b9-863d-f0be9006eb93-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-3f4d6ba4-3903-43b9-863d-f0be9006eb93-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:47 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.info" returned: 0 in 0.317s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:47 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.info is being set with open permissions: ugo+rw
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:47 devstack sudo[96443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.info
Sep 22 15:45:47 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Acquiring lock "cinder-quobyte-3f4d6ba4-3903-43b9-863d-f0be9006eb93" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-quobyte-3f4d6ba4-3903-43b9-863d-f0be9006eb93" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86175d5-8c20-48ef-9e52-103d8d310f85]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:47 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93
Sep 22 15:45:47 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:47 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.info" returned: 0 in 0.302s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.512s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-da47e1ef-fd93-40b1-9659-ba81c1ab1d75 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Create snapshot completed successfully
Sep 22 15:45:48 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93" returned: 0 in 0.491s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:48 devstack sudo[96451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93
Sep 22 15:45:48 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:48 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3f4d6ba4-3903-43b9-863d-f0be9006eb93" returned: 0 in 0.322s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-quobyte-3f4d6ba4-3903-43b9-863d-f0be9006eb93" released by "delete_volume" :: held 0.900s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Created reservations ['ab0f6064-23ce-4a82-9ded-992a0db8da84', '789063df-e9b5-46e9-8428-e947973990de', '09776339-2595-406e-b1f9-797ca87cbf15', '7587bc4a-24a1-46c8-a59e-6451ef28492b'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Acquiring lock "cinder-0cb3f975-95ff-4292-8121-aac5a8f25a7b-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-0cb3f975-95ff-4292-8121-aac5a8f25a7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Acquiring lock "cinder-quobyte-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-quobyte-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Acquiring lock "cinder-quobyte-0cb3f975-95ff-4292-8121-aac5a8f25a7b" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-quobyte-0cb3f975-95ff-4292-8121-aac5a8f25a7b" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Deleting offline snapshot 0cb3f975-95ff-4292-8121-aac5a8f25a7b of volume 4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:45:48 devstack sudo[96454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:48 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] snapshot_file for this snap is: volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e4083-ef43-43e5-836d-6a306f699675]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:49 devstack sudo[96456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b
Sep 22 15:45:49 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:49 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.369s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:49 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Deleted volume successfully.
Sep 22 15:45:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-18543ddf-dbbe-428b-b6bd-895add96e8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-426637675 None] Lock "cinder-3f4d6ba4-3903-43b9-863d-f0be9006eb93-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:49 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b" returned: 0 in 0.499s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:45:49 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2894b15-6455-4406-9a7c-66e95c33066e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:49 devstack sudo[96462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1
Sep 22 15:45:49 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:49 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" returned: 0 in 0.457s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:50 devstack sudo[96468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b
Sep 22 15:45:50 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:50 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b" returned: 0 in 0.454s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:50 devstack sudo[96473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b
Sep 22 15:45:50 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:50 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1.0cb3f975-95ff-4292-8121-aac5a8f25a7b" returned: 0 in 0.356s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-quobyte-0cb3f975-95ff-4292-8121-aac5a8f25a7b" released by "_delete_snapshot" :: held 1.985s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-quobyte-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" released by "delete_snapshot" :: held 2.059s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:51 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Created reservations ['b4687327-8426-43c8-9542-9e40da39ae29', '316c785c-8001-43fc-bb21-f02d06f0bf7c', '235a9d7b-7009-4268-80f6-de5ab7ea64c5', 'a0e25f12-c926-4519-83c1-dcbfb138b53c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:51 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Delete snapshot completed successfully.
Sep 22 15:45:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bdb43d1-d725-487d-8dd9-d09727abe140 tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-0cb3f975-95ff-4292-8121-aac5a8f25a7b-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Flow 'volume_create_manager' (8072fac9-c9e3-426f-b178-b70a633922fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aff6d15-c354-4ae1-b3be-147609b2e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aff6d15-c354-4ae1-b3be-147609b2e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-184504711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d449ee8552141549ae24f2a57c86915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:52Z,use_quota=True,user_id='ef3b618a39804712b2b021c8ca2be8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5337e41-9817-47ed-b6c5-7eff9dd91255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5337e41-9817-47ed-b6c5-7eff9dd91255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c83482-dc44-4de9-be1a-de52e76277cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c83482-dc44-4de9-be1a-de52e76277cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b', 'volume_name': 'volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079719cc-f0fb-4701-9984-2494931bec6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079719cc-f0fb-4701-9984-2494931bec6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5535ad0-57b0-4432-ad99-a1c95facef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:52 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Volume b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b', 'volume_size': 1}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-184504711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d449ee8552141549ae24f2a57c86915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:52Z,use_quota=True,user_id='ef3b618a39804712b2b021c8ca2be8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Creating volume b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:52 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Acquiring lock "cinder-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:52 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b 1073741824
Sep 22 15:45:52 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Acquiring lock "cinder-quobyte-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-quobyte-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f6d463-41c1-4def-a37e-7acd5f91725d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:52 devstack sudo[96478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1
Sep 22 15:45:52 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:52 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b 1073741824" returned: 0 in 0.608s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:52 devstack sudo[96486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b
Sep 22 15:45:52 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:53 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" returned: 0 in 0.580s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:53 devstack sudo[96489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1
Sep 22 15:45:53 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:53 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b" returned: 0 in 0.442s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:53 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5535ad0-57b0-4432-ad99-a1c95facef1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac56aea-e5d3-45df-b546-34c136d87b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-quobyte-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1" released by "delete_volume" :: held 1.011s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:53 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Volume volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b (b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b): created successfully
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac56aea-e5d3-45df-b546-34c136d87b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Flow 'volume_create_manager' (8072fac9-c9e3-426f-b178-b70a633922fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f3ca6629-2adf-4e3d-a6ab-37c39101bbc7 tempest-VolumesListTestJSON-1868795545 None] Created volume successfully.
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Created reservations ['53f1c5f7-534a-496c-b55f-a1c68fcee73d', 'e9aa1346-0194-48f9-988c-3363ce21f2af', '227466de-a06e-461f-9b14-fa3d4d385c6d', '587cb200-b6a0-4a7d-9192-afbf17ad2454'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:53 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:45:53 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:53 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.309s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:45:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Deleted volume successfully.
Sep 22 15:45:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2d40d3-89a1-4dc8-825e-4d8af0cb2edc tempest-VolumesSnapshotNegativeTestJSON-1669039203 None] Lock "cinder-4db52f9d-80c4-4a42-b730-9fc4cc9d3fb1-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:45:54 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Flow 'volume_create_manager' (00ca3b83-bb69-41c0-96a3-c103bdd10a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d16c37-63be-46b7-abd6-9aebc5de9519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d16c37-63be-46b7-abd6-9aebc5de9519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1306656541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d329ed2b-a71a-4ad3-8a79-65dd5bd47c72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d449ee8552141549ae24f2a57c86915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:55Z,use_quota=True,user_id='ef3b618a39804712b2b021c8ca2be8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db147a1c-797d-4c2a-b3b3-d954dbd257d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db147a1c-797d-4c2a-b3b3-d954dbd257d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28cf12a-a13f-4bc1-b538-0f102b3ee9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28cf12a-a13f-4bc1-b538-0f102b3ee9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd329ed2b-a71a-4ad3-8a79-65dd5bd47c72', 'volume_name': 'volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1637ea-9246-427e-8a7f-856949b1ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1637ea-9246-427e-8a7f-856949b1ebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb00dd7-2a0d-4ce7-82b3-331a5bab6c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:55 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Volume d329ed2b-a71a-4ad3-8a79-65dd5bd47c72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72', 'volume_size': 1}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1306656541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d329ed2b-a71a-4ad3-8a79-65dd5bd47c72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d449ee8552141549ae24f2a57c86915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:55Z,use_quota=True,user_id='ef3b618a39804712b2b021c8ca2be8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Creating volume d329ed2b-a71a-4ad3-8a79-65dd5bd47c72 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:55 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:55 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72 1073741824
Sep 22 15:45:55 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:55 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72 1073741824" returned: 0 in 0.571s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:55 devstack sudo[96502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72
Sep 22 15:45:55 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:56 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72" returned: 0 in 0.395s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb00dd7-2a0d-4ce7-82b3-331a5bab6c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562438e0-fca9-4427-86ae-4c5b7d9ef95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:56 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Volume volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72 (d329ed2b-a71a-4ad3-8a79-65dd5bd47c72): created successfully
Sep 22 15:45:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562438e0-fca9-4427-86ae-4c5b7d9ef95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Flow 'volume_create_manager' (00ca3b83-bb69-41c0-96a3-c103bdd10a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:56 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e903a385-01e2-4de7-82ab-2b64b04df8f6 tempest-VolumesListTestJSON-1868795545 None] Created volume successfully.
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Flow 'volume_create_manager' (bda71d94-4c75-474d-b165-9f78fbe80465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2e66d8-3ff6-458b-8f94-86412280920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2e66d8-3ff6-458b-8f94-86412280920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-870032285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38987856-d8f8-47ec-afc9-8624598fc914,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d449ee8552141549ae24f2a57c86915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:58Z,use_quota=True,user_id='ef3b618a39804712b2b021c8ca2be8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac3b04f-36a2-4384-b93a-57eafe88854b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac3b04f-36a2-4384-b93a-57eafe88854b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63103257-6aeb-4c9e-acbe-43165b12450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63103257-6aeb-4c9e-acbe-43165b12450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38987856-d8f8-47ec-afc9-8624598fc914', 'volume_name': 'volume-38987856-d8f8-47ec-afc9-8624598fc914', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc765ca-9217-48f3-a253-b91a13156d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc765ca-9217-48f3-a253-b91a13156d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd200c89-4fb1-4ee2-ba2d-5f3be12964ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:57 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Volume 38987856-d8f8-47ec-afc9-8624598fc914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38987856-d8f8-47ec-afc9-8624598fc914', 'volume_size': 1}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-870032285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38987856-d8f8-47ec-afc9-8624598fc914,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d449ee8552141549ae24f2a57c86915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:45:58Z,use_quota=True,user_id='ef3b618a39804712b2b021c8ca2be8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Creating volume 38987856-d8f8-47ec-afc9-8624598fc914 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:45:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:45:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:45:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:45:58 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:45:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:58 devstack sudo[96505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914 1073741824
Sep 22 15:45:58 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:58 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914 1073741824" returned: 0 in 0.593s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:45:58 devstack sudo[96511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914
Sep 22 15:45:58 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:45:59 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root
Sep 22 15:45:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914" returned: 0 in 0.373s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:45:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:45:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:45:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd200c89-4fb1-4ee2-ba2d-5f3be12964ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38987856-d8f8-47ec-afc9-8624598fc914', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11b0ce3-e371-40b3-b7cb-223b69f29538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:45:59 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Volume volume-38987856-d8f8-47ec-afc9-8624598fc914 (38987856-d8f8-47ec-afc9-8624598fc914): created successfully
Sep 22 15:45:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11b0ce3-e371-40b3-b7cb-223b69f29538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:45:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Flow 'volume_create_manager' (bda71d94-4c75-474d-b165-9f78fbe80465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:45:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3ebc92fb-a4c4-4ad3-8e4f-f924ca2e4062 tempest-VolumesListTestJSON-1868795545 None] Created volume successfully.
Sep 22 15:46:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "cinder-38987856-d8f8-47ec-afc9-8624598fc914-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-38987856-d8f8-47ec-afc9-8624598fc914-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "cinder-quobyte-38987856-d8f8-47ec-afc9-8624598fc914" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-quobyte-38987856-d8f8-47ec-afc9-8624598fc914" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b443410-77dd-4f07-bfc2-3324fbae3a04]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:03 devstack sudo[96517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914
Sep 22 15:46:03 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:03 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914" returned: 0 in 0.537s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:03 devstack sudo[96522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914
Sep 22 15:46:03 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:03 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-38987856-d8f8-47ec-afc9-8624598fc914" returned: 0 in 0.377s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-quobyte-38987856-d8f8-47ec-afc9-8624598fc914" released by "delete_volume" :: held 0.974s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Created reservations ['eca7d2c0-5083-47b7-854f-89b4ed038921', 'c81008c5-8dca-4bc4-b55a-490614ef96fe', '8867df0c-b854-448e-9be9-76f6b824281d', 'ed1ae033-6abc-4b3e-b405-05ecb103a5ce'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:04 devstack sudo[96525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:46:04 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:04 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.342s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:46:04 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Deleted volume successfully.
Sep 22 15:46:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9d8b8456-60c3-4fa3-901c-75e6e118ec12 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-38987856-d8f8-47ec-afc9-8624598fc914-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "cinder-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "cinder-quobyte-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-quobyte-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:05 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8dafa4-d154-445f-ab8f-c0eae2f9a056]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:05 devstack sudo[96562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72
Sep 22 15:46:05 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:06 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72" returned: 0 in 0.540s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:06 devstack sudo[96569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72
Sep 22 15:46:06 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:06 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72" returned: 0 in 0.362s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-quobyte-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72" released by "delete_volume" :: held 0.968s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=89,cinder:INSERT=33,cinder:UPDATE=111,cinder:DELETE=8 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=96,cinder:UPDATE=131,cinder:DELETE=13,cinder:INSERT=23 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Created reservations ['dc8af629-c56e-431b-a700-10912814e250', 'f6f23c75-6303-485e-b1ba-be4363514d2e', '32382ab7-a2a6-4ad0-9425-aca5a8153033', 'e14ae4c9-4a13-417a-a5ec-c8a8dd7edd4c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:06 devstack sudo[96572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:46:06 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:06 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.296s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:46:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Deleted volume successfully.
Sep 22 15:46:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-484a39b3-b9be-42fd-870f-6ae339a39124 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-d329ed2b-a71a-4ad3-8a79-65dd5bd47c72-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "cinder-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "cinder-quobyte-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-quobyte-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:08 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cfb2b5-ff67-4dd8-a1ba-a7cfba308e91]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:08 devstack sudo[96575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b
Sep 22 15:46:08 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:08 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b" returned: 0 in 0.516s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:08 devstack sudo[96580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b
Sep 22 15:46:08 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:08 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b" returned: 0 in 0.369s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-quobyte-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b" released by "delete_volume" :: held 0.969s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Created reservations ['1206ba30-cf9d-429c-b2cb-5df8d100d905', 'ddcb1f93-8314-43b6-bf4f-a30e0779804b', '81abacb2-4b23-41e6-b834-0c0cde38be59', 'bd7532b7-9f37-452e-823f-8ec33b36218b'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:09 devstack sudo[96583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:46:09 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:09 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.384s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:46:09 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Deleted volume successfully.
Sep 22 15:46:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d73f3e97-6d84-4c8a-801d-d6f89f71e590 tempest-VolumesListTestJSON-1868795545 None] Lock "cinder-b6b43e1a-6019-4c54-a4c6-0449aa2a1f6b-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:19 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=17 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:46:19 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:INSERT=4,cinder:UPDATE=14,cinder:SELECT=7,cinder:DELETE=2 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Flow 'volume_create_manager' (c7969749-0106-4949-be7a-61ad72e86d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b73405b-ce1b-4923-94d5-62046bda6c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b73405b-ce1b-4923-94d5-62046bda6c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1182958123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572a250f-5315-4b0a-a852-a1eec276183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f465463c43643dcba05b25f5398f711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:26Z,use_quota=True,user_id='19458a2ba59b4304bd0696fd7c47ba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c86144-407a-4abb-9699-333a817b763d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c86144-407a-4abb-9699-333a817b763d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3408a176-c809-4a54-bdb9-dcbda13ecb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3408a176-c809-4a54-bdb9-dcbda13ecb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572a250f-5315-4b0a-a852-a1eec276183d', 'volume_name': 'volume-572a250f-5315-4b0a-a852-a1eec276183d', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832352a6-1301-4c5d-ab7e-d143021ffe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832352a6-1301-4c5d-ab7e-d143021ffe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62506aa-f06f-46c9-ba52-1d23a722f511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:25 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Volume 572a250f-5315-4b0a-a852-a1eec276183d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572a250f-5315-4b0a-a852-a1eec276183d', 'volume_size': 1}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1182958123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572a250f-5315-4b0a-a852-a1eec276183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f465463c43643dcba05b25f5398f711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:26Z,use_quota=True,user_id='19458a2ba59b4304bd0696fd7c47ba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Creating volume 572a250f-5315-4b0a-a852-a1eec276183d {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:46:25 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:46:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:25 devstack sudo[96596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d 1073741824
Sep 22 15:46:25 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:26 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d 1073741824" returned: 0 in 0.563s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:26 devstack sudo[96602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d
Sep 22 15:46:26 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:26 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d" returned: 0 in 0.342s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:46:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62506aa-f06f-46c9-ba52-1d23a722f511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572a250f-5315-4b0a-a852-a1eec276183d', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1877d878-88b0-4906-8feb-c45516ff70d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:26 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Volume volume-572a250f-5315-4b0a-a852-a1eec276183d (572a250f-5315-4b0a-a852-a1eec276183d): created successfully
Sep 22 15:46:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1877d878-88b0-4906-8feb-c45516ff70d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Flow 'volume_create_manager' (c7969749-0106-4949-be7a-61ad72e86d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:26 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-65f4bb4a-be2b-45fd-b032-6cfcc2032f5f tempest-VolumesListAdminTestJSON-873635804 None] Created volume successfully.
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Flow 'volume_create_manager' (813a2536-130c-4396-9325-fa5917519629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a013a8ee-011a-43f1-842b-2138dcede163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a013a8ee-011a-43f1-842b-2138dcede163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2079355641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbd2250-6d0e-4be6-aa55-9625926f5db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f465463c43643dcba05b25f5398f711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:28Z,use_quota=True,user_id='19458a2ba59b4304bd0696fd7c47ba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9375a5-e0c3-4a75-b3c8-349506204158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9375a5-e0c3-4a75-b3c8-349506204158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4fc816-4271-4d2c-bf38-882e12491bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4fc816-4271-4d2c-bf38-882e12491bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dbd2250-6d0e-4be6-aa55-9625926f5db3', 'volume_name': 'volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28dc0fd9-07de-4b67-9146-e0d43d83e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28dc0fd9-07de-4b67-9146-e0d43d83e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1decb74-7c7a-4c60-b1c8-b30a082b9f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:28 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Volume 5dbd2250-6d0e-4be6-aa55-9625926f5db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3', 'volume_size': 1}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2079355641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbd2250-6d0e-4be6-aa55-9625926f5db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f465463c43643dcba05b25f5398f711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:28Z,use_quota=True,user_id='19458a2ba59b4304bd0696fd7c47ba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Creating volume 5dbd2250-6d0e-4be6-aa55-9625926f5db3 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:46:28 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:28 devstack sudo[96606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3 1073741824
Sep 22 15:46:28 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:28 devstack sudo[96607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:46:28 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:29 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.467s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:46:29 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3 1073741824" returned: 0 in 0.787s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:29 devstack sudo[96618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3
Sep 22 15:46:29 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:29 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3" returned: 0 in 0.377s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1decb74-7c7a-4c60-b1c8-b30a082b9f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cca8f5-df6f-4a48-991a-75281b934749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:29 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Volume volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3 (5dbd2250-6d0e-4be6-aa55-9625926f5db3): created successfully
Sep 22 15:46:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cca8f5-df6f-4a48-991a-75281b934749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Flow 'volume_create_manager' (813a2536-130c-4396-9325-fa5917519629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:30 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-64fe9f94-bbc6-4940-8637-c80ff4c07b58 tempest-VolumesListAdminTestJSON-873635804 None] Created volume successfully.
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Flow 'volume_create_manager' (fa752c15-56f6-42f3-bf99-91ae75f54860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247820f1-2868-4301-bdd8-0a8ab16364e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247820f1-2868-4301-bdd8-0a8ab16364e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-376004514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a359a-9f35-4ccc-85d5-b07226397309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f465463c43643dcba05b25f5398f711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:31Z,use_quota=True,user_id='19458a2ba59b4304bd0696fd7c47ba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26658fc-b85b-44d8-83de-d29e91841e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26658fc-b85b-44d8-83de-d29e91841e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad4066e-b92d-4d57-8bbb-83bcaaad6dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad4066e-b92d-4d57-8bbb-83bcaaad6dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805a359a-9f35-4ccc-85d5-b07226397309', 'volume_name': 'volume-805a359a-9f35-4ccc-85d5-b07226397309', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c7295e-a6dd-44c3-8c9b-cc653fff412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c7295e-a6dd-44c3-8c9b-cc653fff412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6280ad65-f25c-4a53-b9bb-4d2551ffd3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:31 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Volume 805a359a-9f35-4ccc-85d5-b07226397309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805a359a-9f35-4ccc-85d5-b07226397309', 'volume_size': 1}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-376004514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a359a-9f35-4ccc-85d5-b07226397309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f465463c43643dcba05b25f5398f711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:31Z,use_quota=True,user_id='19458a2ba59b4304bd0696fd7c47ba67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Creating volume 805a359a-9f35-4ccc-85d5-b07226397309 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:46:31 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:46:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:31 devstack sudo[96622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309 1073741824
Sep 22 15:46:31 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:32 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309 1073741824" returned: 0 in 0.711s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:32 devstack sudo[96641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309
Sep 22 15:46:32 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:32 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309" returned: 0 in 0.360s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:46:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6280ad65-f25c-4a53-b9bb-4d2551ffd3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805a359a-9f35-4ccc-85d5-b07226397309', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48671b39-8f66-4f2b-9e10-ae47e1870180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:32 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Volume volume-805a359a-9f35-4ccc-85d5-b07226397309 (805a359a-9f35-4ccc-85d5-b07226397309): created successfully
Sep 22 15:46:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48671b39-8f66-4f2b-9e10-ae47e1870180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Flow 'volume_create_manager' (fa752c15-56f6-42f3-bf99-91ae75f54860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-02aeb189-ff5b-4121-9a2f-5132800377cc tempest-VolumesListAdminTestJSON-873635804 None] Created volume successfully.
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Flow 'volume_create_manager' (a3208d64-ef16-46f1-893c-74061b15dfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4332e561-50d8-4204-9b23-9954904d22be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4332e561-50d8-4204-9b23-9954904d22be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb7389a-07b1-45de-bdbd-a88905b81456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290a5dd84cd4312b391f49b7c52f315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:34Z,use_quota=True,user_id='a5f2561d0c8141dba7694f578355b7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f55713d-1c36-42f2-b226-d7ca8c0571f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f55713d-1c36-42f2-b226-d7ca8c0571f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3564f4-8c38-4b10-829c-470fc5239800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3564f4-8c38-4b10-829c-470fc5239800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb7389a-07b1-45de-bdbd-a88905b81456', 'volume_name': 'volume-7fb7389a-07b1-45de-bdbd-a88905b81456', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d86adc-2e72-4880-97b3-7812c4f32044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d86adc-2e72-4880-97b3-7812c4f32044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8855e9-cc66-4df8-a794-9a3b1d10a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:34 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Volume 7fb7389a-07b1-45de-bdbd-a88905b81456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb7389a-07b1-45de-bdbd-a88905b81456', 'volume_size': 1}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb7389a-07b1-45de-bdbd-a88905b81456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290a5dd84cd4312b391f49b7c52f315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:34Z,use_quota=True,user_id='a5f2561d0c8141dba7694f578355b7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Creating volume 7fb7389a-07b1-45de-bdbd-a88905b81456 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:46:34 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:46:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:34 devstack sudo[96648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456 1073741824
Sep 22 15:46:34 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:35 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456 1073741824" returned: 0 in 0.593s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:35 devstack sudo[96655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456
Sep 22 15:46:35 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:35 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456" returned: 0 in 0.389s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:46:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8855e9-cc66-4df8-a794-9a3b1d10a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb7389a-07b1-45de-bdbd-a88905b81456', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d71b5a-f9b8-46a2-a4d7-780472e4fea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:35 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Volume volume-7fb7389a-07b1-45de-bdbd-a88905b81456 (7fb7389a-07b1-45de-bdbd-a88905b81456): created successfully
Sep 22 15:46:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d71b5a-f9b8-46a2-a4d7-780472e4fea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Flow 'volume_create_manager' (a3208d64-ef16-46f1-893c-74061b15dfd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1f7ad7ad-4863-44c6-8f29-b10d9143a0ba tempest-VolumesListAdminTestJSON-1775628293 None] Created volume successfully.
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (2f6b6b49-131a-4046-8c3f-0715b46d46b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4eea0f2-c9db-43b8-9a98-b49ae0de65af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4eea0f2-c9db-43b8-9a98-b49ae0de65af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-564924384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=440c9e27-6289-437f-8bd8-413478501ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fa74984aac461697658f154f1d0ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:36Z,use_quota=True,user_id='f4454870f5564ac4be5ffff4a5967d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3c0767-52de-41c2-abd8-3775a4ed36ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3c0767-52de-41c2-abd8-3775a4ed36ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8af99f2-2f21-4a52-b870-5fe8bf3aa2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8af99f2-2f21-4a52-b870-5fe8bf3aa2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '440c9e27-6289-437f-8bd8-413478501ad6', 'volume_name': 'volume-440c9e27-6289-437f-8bd8-413478501ad6', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99eefbd-7702-4518-871c-b91929235039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99eefbd-7702-4518-871c-b91929235039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4606be52-a153-49d6-b9e8-2b663483e011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Volume 440c9e27-6289-437f-8bd8-413478501ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-440c9e27-6289-437f-8bd8-413478501ad6', 'volume_size': 1}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-564924384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=440c9e27-6289-437f-8bd8-413478501ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fa74984aac461697658f154f1d0ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:36Z,use_quota=True,user_id='f4454870f5564ac4be5ffff4a5967d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Creating volume 440c9e27-6289-437f-8bd8-413478501ad6 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:46:36 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:36 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6 1073741824
Sep 22 15:46:36 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Flow 'volume_create_manager' (96ff2a32-bf4e-4246-84e1-4d8d091c0756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075b2eb4-f299-4362-b62a-a5ebe316b87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075b2eb4-f299-4362-b62a-a5ebe316b87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1704312617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8f0793-1294-4a45-9820-7b37cb7484cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395d024a919f4c78bbe0eb6aceb169cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:37Z,use_quota=True,user_id='0c4ddd6671d14c0891ecdc12eea9d5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23cfad-574c-4cb9-b0f0-a7b092440bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23cfad-574c-4cb9-b0f0-a7b092440bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4391dc7-6955-48e9-8c6b-c3c82615d7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4391dc7-6955-48e9-8c6b-c3c82615d7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8f0793-1294-4a45-9820-7b37cb7484cb', 'volume_name': 'volume-ef8f0793-1294-4a45-9820-7b37cb7484cb', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c594b4-ead3-4a91-869b-75043216ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c594b4-ead3-4a91-869b-75043216ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ce1ca4-b1c1-4d2e-be76-02bab037aad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:36 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Volume ef8f0793-1294-4a45-9820-7b37cb7484cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8f0793-1294-4a45-9820-7b37cb7484cb', 'volume_size': 1}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Acquiring lock "cinder-7fb7389a-07b1-45de-bdbd-a88905b81456-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6 1073741824" returned: 0 in 0.701s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Lock "cinder-7fb7389a-07b1-45de-bdbd-a88905b81456-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:37 devstack sudo[96665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6
Sep 22 15:46:37 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Acquiring lock "cinder-quobyte-7fb7389a-07b1-45de-bdbd-a88905b81456" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Lock "cinder-quobyte-7fb7389a-07b1-45de-bdbd-a88905b81456" acquired by "delete_volume" :: waited 0.044s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "cinder-805a359a-9f35-4ccc-85d5-b07226397309-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d11dd7e-def8-42bc-a36b-baddd58d0f63]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-805a359a-9f35-4ccc-85d5-b07226397309-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "cinder-quobyte-805a359a-9f35-4ccc-85d5-b07226397309" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-quobyte-805a359a-9f35-4ccc-85d5-b07226397309" acquired by "delete_volume" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b4a937-8558-4376-9fcc-1bff5f72340e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:37 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6" returned: 0 in 0.459s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:37 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456
Sep 22 15:46:37 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1704312617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8f0793-1294-4a45-9820-7b37cb7484cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395d024a919f4c78bbe0eb6aceb169cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:37Z,use_quota=True,user_id='0c4ddd6671d14c0891ecdc12eea9d5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Creating volume ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:46:37 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:37 devstack sudo[96684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb 1073741824
Sep 22 15:46:37 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4606be52-a153-49d6-b9e8-2b663483e011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-440c9e27-6289-437f-8bd8-413478501ad6', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023d87e8-d39e-4aa8-bbc2-a3b6457ad07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:37 devstack sudo[96677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309
Sep 22 15:46:37 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:37 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Volume volume-440c9e27-6289-437f-8bd8-413478501ad6 (440c9e27-6289-437f-8bd8-413478501ad6): created successfully
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023d87e8-d39e-4aa8-bbc2-a3b6457ad07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (2f6b6b49-131a-4046-8c3f-0715b46d46b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:37 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e750ac31-7b68-48f3-adfd-b299b251498e tempest-VolumesSnapshotTestJSON-1730332229 None] Created volume successfully.
Sep 22 15:46:38 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456" returned: 0 in 0.928s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:38 devstack sudo[96726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456
Sep 22 15:46:38 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:38 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309" returned: 0 in 1.143s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:38 devstack sudo[96746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309
Sep 22 15:46:38 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:38 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7fb7389a-07b1-45de-bdbd-a88905b81456" returned: 0 in 0.696s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:38 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb 1073741824" returned: 0 in 1.314s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Lock "cinder-quobyte-7fb7389a-07b1-45de-bdbd-a88905b81456" released by "delete_volume" :: held 1.774s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:39 devstack sudo[96754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb
Sep 22 15:46:39 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Created reservations ['c3d25cb1-e1fc-4723-96b8-67ecee0211a2', '8af117de-b5f0-49e2-ade5-cedf4c340427', '809dd531-2a21-4847-9c0e-23ae2f32ac31', 'd989d55d-0757-43b6-825e-a2fdfdff25d7'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:46:39 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:39 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb" returned: 0 in 0.631s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-805a359a-9f35-4ccc-85d5-b07226397309" returned: 0 in 1.063s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:39 devstack sudo[96763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:46:39 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.079s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-quobyte-805a359a-9f35-4ccc-85d5-b07226397309" released by "delete_volume" :: held 2.419s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ce1ca4-b1c1-4d2e-be76-02bab037aad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8f0793-1294-4a45-9820-7b37cb7484cb', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14a5f65-1338-4dd1-a71a-cb2ce13c5310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Creating offline snapshot 42f84e29-801f-4cef-9fc9-0a269546a4ff of volume 440c9e27-6289-437f-8bd8-413478501ad6 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:46:39 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Volume volume-ef8f0793-1294-4a45-9820-7b37cb7484cb (ef8f0793-1294-4a45-9820-7b37cb7484cb): created successfully
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14a5f65-1338-4dd1-a71a-cb2ce13c5310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Flow 'volume_create_manager' (96ff2a32-bf4e-4246-84e1-4d8d091c0756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f3180-404a-4458-ad1c-a0727c1771a3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f0be9fcf-53ed-4dd7-aba2-f672ba350547 tempest-TestStampPattern-819849900 None] Created volume successfully.
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Created reservations ['f002d3f6-beeb-4c0d-a63b-200931a1778e', '3c934a4d-d95d-4f25-b911-34468b8e8e75', 'c2ab0954-7913-401e-8e57-a4f6664e997a', 'faa9a498-89c8-4b56-9a3f-ffff2c85caf5'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:46:40 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.799s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:46:40 devstack sudo[96768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6
Sep 22 15:46:40 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Deleted volume successfully.
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d15333b4-ea6a-46b1-bf74-fb1482b1ae03 tempest-VolumesListAdminTestJSON-1775628293 None] Lock "cinder-7fb7389a-07b1-45de-bdbd-a88905b81456-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:40 devstack sudo[96772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:46:40 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:40 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6" returned: 0 in 0.787s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:40 devstack sudo[96778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff 1G
Sep 22 15:46:40 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:40 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.479s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:46:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Deleted volume successfully.
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "cinder-5dbd2250-6d0e-4be6-aa55-9625926f5db3-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-5dbd2250-6d0e-4be6-aa55-9625926f5db3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-62b457c3-cff5-4775-93e9-b5c9f6b5dc7d tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-805a359a-9f35-4ccc-85d5-b07226397309-delete_volume" released by "delete_volume" :: held 3.744s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "cinder-quobyte-5dbd2250-6d0e-4be6-aa55-9625926f5db3" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-quobyte-5dbd2250-6d0e-4be6-aa55-9625926f5db3" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:41 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9124b859-cd55-4bed-9dfd-741bd1fd1701]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:41 devstack sudo[96780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3
Sep 22 15:46:41 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:41 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3" returned: 0 in 0.552s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:41 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff 1G" returned: 0 in 0.942s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-440c9e27-6289-437f-8bd8-413478501ad6 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:41 devstack sudo[96788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3
Sep 22 15:46:41 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:41 devstack sudo[96789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-440c9e27-6289-437f-8bd8-413478501ad6 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff
Sep 22 15:46:41 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:42 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-440c9e27-6289-437f-8bd8-413478501ad6 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff" returned: 0 in 0.597s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:42 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff is being set with open permissions: ugo+rw
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:42 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5dbd2250-6d0e-4be6-aa55-9625926f5db3" returned: 0 in 0.667s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:42 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff
Sep 22 15:46:42 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-quobyte-5dbd2250-6d0e-4be6-aa55-9625926f5db3" released by "delete_volume" :: held 1.339s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Created reservations ['632aedb0-352f-4b01-b5d7-50453940672a', 'fac86bd0-3125-476f-a3b5-fc2dbebe54f6', '770618e6-d31d-4e16-ad27-8a5f2b1021b9', '56a822cf-4cb1-47f2-8c0f-e8dbc597227b'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:42 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff" returned: 0 in 0.611s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:42 devstack sudo[96802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:46:42 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:43 devstack sudo[96804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.info
Sep 22 15:46:43 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:43 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.471s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:46:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Deleted volume successfully.
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (7efc2260-d26c-4ec7-8ad3-b5738ad8012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b38e26-57b6-431a-8737-39011d9c14b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-36544c6a-6c73-4c2e-a263-62ca4e2815ef tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-5dbd2250-6d0e-4be6-aa55-9625926f5db3-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b38e26-57b6-431a-8737-39011d9c14b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-825886394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3636b22-5ef9-4a98-bec2-993dc96356c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:43Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c18ad2f-fe19-4deb-a894-8bf81c14c882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c18ad2f-fe19-4deb-a894-8bf81c14c882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b025b918-1ed2-4588-8aba-fd67e55e9b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b025b918-1ed2-4588-8aba-fd67e55e9b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3636b22-5ef9-4a98-bec2-993dc96356c1', 'volume_name': 'volume-b3636b22-5ef9-4a98-bec2-993dc96356c1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:43 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d9849c-b89a-4324-a7e9-746de6e9b349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d9849c-b89a-4324-a7e9-746de6e9b349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88df8312-2018-4ec9-8b24-858482bf6b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Volume b3636b22-5ef9-4a98-bec2-993dc96356c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3636b22-5ef9-4a98-bec2-993dc96356c1', 'volume_size': 1}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "cinder-572a250f-5315-4b0a-a852-a1eec276183d-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.info" returned: 0 in 0.749s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:43 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.info is being set with open permissions: ugo+rw
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:43 devstack sudo[96821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.info
Sep 22 15:46:43 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-572a250f-5315-4b0a-a852-a1eec276183d-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "cinder-quobyte-572a250f-5315-4b0a-a852-a1eec276183d" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-quobyte-572a250f-5315-4b0a-a852-a1eec276183d" acquired by "delete_volume" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2180ee67-3daa-4cf0-b93f-ef18243c171a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:44 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.info" returned: 0 in 0.423s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.596s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:44 devstack sudo[96826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d
Sep 22 15:46:44 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-825886394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3636b22-5ef9-4a98-bec2-993dc96356c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:43Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Creating volume b3636b22-5ef9-4a98-bec2-993dc96356c1 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:46:44 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:44 devstack sudo[96834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1 1073741824
Sep 22 15:46:44 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:44 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-66e1457e-9736-4580-a887-c8c540dde7db tempest-VolumesSnapshotTestJSON-1730332229 None] Create snapshot completed successfully
Sep 22 15:46:44 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d" returned: 0 in 0.881s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:45 devstack sudo[96848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d
Sep 22 15:46:45 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-42f84e29-801f-4cef-9fc9-0a269546a4ff-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-42f84e29-801f-4cef-9fc9-0a269546a4ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:45 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1 1073741824" returned: 0 in 0.984s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-440c9e27-6289-437f-8bd8-413478501ad6" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-440c9e27-6289-437f-8bd8-413478501ad6" acquired by "delete_snapshot" :: waited 0.056s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-42f84e29-801f-4cef-9fc9-0a269546a4ff" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:45 devstack sudo[96850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1
Sep 22 15:46:45 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-42f84e29-801f-4cef-9fc9-0a269546a4ff" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Deleting offline snapshot 42f84e29-801f-4cef-9fc9-0a269546a4ff of volume 440c9e27-6289-437f-8bd8-413478501ad6 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] snapshot_file for this snap is: volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:46:45 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-572a250f-5315-4b0a-a852-a1eec276183d" returned: 0 in 0.586s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f31e2a-9ccc-4b46-a627-5579ae0bd731]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-quobyte-572a250f-5315-4b0a-a852-a1eec276183d" released by "delete_volume" :: held 1.621s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Created reservations ['8f0e0c60-0707-4c49-9c56-6321e004adc1', 'd084d5d7-1ae1-42aa-a3fe-3a9f41255b4c', 'd8d97cc1-0b5e-4b6d-8f1a-aa5d40b91ab6', 'b2387830-9317-4507-9951-68d8d7ab1eae'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:46:45 devstack sudo[96853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff
Sep 22 15:46:45 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:45 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1" returned: 0 in 0.486s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:45 devstack sudo[96856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88df8312-2018-4ec9-8b24-858482bf6b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3636b22-5ef9-4a98-bec2-993dc96356c1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:45 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2820e4-8efc-4a1c-bda4-cca3fb37dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:45 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Volume volume-b3636b22-5ef9-4a98-bec2-993dc96356c1 (b3636b22-5ef9-4a98-bec2-993dc96356c1): created successfully
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2820e4-8efc-4a1c-bda4-cca3fb37dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (7efc2260-d26c-4ec7-8ad3-b5738ad8012c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a8aee36a-24b1-4de5-aa96-a733f06a079c tempest-VolumesActionsTest-321046187 None] Created volume successfully.
Sep 22 15:46:46 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff" returned: 0 in 0.602s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-440c9e27-6289-437f-8bd8-413478501ad6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b177cd-0c17-49ac-9e8f-39291e25159e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:46 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.591s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:46:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Deleted volume successfully.
Sep 22 15:46:46 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6
Sep 22 15:46:46 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0d70da66-891d-4f50-983f-f75347d4afda tempest-VolumesListAdminTestJSON-873635804 None] Lock "cinder-572a250f-5315-4b0a-a852-a1eec276183d-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6a32a814-7e42-44b7-a629-13fd4c7011f4 tempest-VolumesActionsTest-321046187 None] Acquiring lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1" by "attach_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6a32a814-7e42-44b7-a629-13fd4c7011f4 tempest-VolumesActionsTest-321046187 None] Lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1" acquired by "attach_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6a32a814-7e42-44b7-a629-13fd4c7011f4 tempest-VolumesActionsTest-321046187 None] Attaching volume b3636b22-5ef9-4a98-bec2-993dc96356c1 to instance 32807ecd-fe80-4565-9a44-915903a7d95b at mountpoint /dev/vdb on host None.
Sep 22 15:46:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6a32a814-7e42-44b7-a629-13fd4c7011f4 tempest-VolumesActionsTest-321046187 None] Attach volume completed successfully.
Sep 22 15:46:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6a32a814-7e42-44b7-a629-13fd4c7011f4 tempest-VolumesActionsTest-321046187 None] Lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1" released by "attach_volume" :: held 0.225s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:47 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6" returned: 0 in 0.797s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:47 devstack sudo[96869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff
Sep 22 15:46:47 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:47 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff" returned: 0 in 0.616s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:47 devstack sudo[96875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff
Sep 22 15:46:47 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:48 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a1f0cffa-5491-4364-a2a9-2573de4a6933 tempest-VolumesActionsTest-1197755678 None] Terminate volume connection completed successfully.
Sep 22 15:46:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6.42f84e29-801f-4cef-9fc9-0a269546a4ff" returned: 0 in 0.466s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a1f0cffa-5491-4364-a2a9-2573de4a6933 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1-detach_volume" by "detach_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-42f84e29-801f-4cef-9fc9-0a269546a4ff" released by "_delete_snapshot" :: held 2.771s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-440c9e27-6289-437f-8bd8-413478501ad6" released by "delete_snapshot" :: held 2.840s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a1f0cffa-5491-4364-a2a9-2573de4a6933 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1-detach_volume" acquired by "detach_volume" :: waited 0.094s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a1f0cffa-5491-4364-a2a9-2573de4a6933 tempest-VolumesActionsTest-1197755678 None] Detaching volume b3636b22-5ef9-4a98-bec2-993dc96356c1 from instance 32807ecd-fe80-4565-9a44-915903a7d95b.
Sep 22 15:46:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a1f0cffa-5491-4364-a2a9-2573de4a6933 tempest-VolumesActionsTest-1197755678 None] Detach volume completed successfully.
Sep 22 15:46:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a1f0cffa-5491-4364-a2a9-2573de4a6933 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1-detach_volume" released by "detach_volume" :: held 0.326s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:48 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Created reservations ['80759b8b-66aa-4336-8861-9f0b964063fa', '299d10f7-9c57-45e5-83cf-2681257cb168', 'e9f3e62b-8501-4a7f-bf66-bef7392fb9bb', '7e8feac6-063d-4394-a400-2cb2396ac2b2'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:46:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Delete snapshot completed successfully.
Sep 22 15:46:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2d14f6dc-4299-4aa7-9aae-8650133e3b63 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-42f84e29-801f-4cef-9fc9-0a269546a4ff-delete_snapshot" released by "delete_snapshot" :: held 3.776s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6c188bf2-319a-4365-909f-f1e7ce8c4700 tempest-VolumesActionsTest-321046187 None] Acquiring lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1-detach_volume" by "detach_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6c188bf2-319a-4365-909f-f1e7ce8c4700 tempest-VolumesActionsTest-321046187 None] Lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6c188bf2-319a-4365-909f-f1e7ce8c4700 tempest-VolumesActionsTest-321046187 None] Volume detach called, but volume not attached.
Sep 22 15:46:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6c188bf2-319a-4365-909f-f1e7ce8c4700 tempest-VolumesActionsTest-321046187 None] Lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Acquiring lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Acquiring lock "cinder-quobyte-b3636b22-5ef9-4a98-bec2-993dc96356c1" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:46:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Lock "cinder-quobyte-b3636b22-5ef9-4a98-bec2-993dc96356c1" acquired by "delete_volume" :: waited 0.042s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:46:50 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3cfaa4-c319-4f8f-a283-d5bb394d1cd7]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:50 devstack sudo[96944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1
Sep 22 15:46:50 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:51 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1" returned: 0 in 1.066s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:51 devstack sudo[96952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1
Sep 22 15:46:51 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (85e4b626-f7db-4553-b67d-58aeceaf9268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b014fe65-e5a9-42cf-be5e-e6e9dc8c840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b014fe65-e5a9-42cf-be5e-e6e9dc8c840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-793457727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e157ba-eb51-4c21-820b-cd0c4abfbe06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fa74984aac461697658f154f1d0ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:51Z,use_quota=True,user_id='f4454870f5564ac4be5ffff4a5967d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3e7c53-610c-47c7-924b-504595dc0915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3e7c53-610c-47c7-924b-504595dc0915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8064b01-4368-4a67-9051-b3980dff04b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8064b01-4368-4a67-9051-b3980dff04b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94e157ba-eb51-4c21-820b-cd0c4abfbe06', 'volume_name': 'volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df02009c-b19c-4735-a73c-eecc50422100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df02009c-b19c-4735-a73c-eecc50422100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945a97a3-c74f-41f1-a362-f3fcc7bfb394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:51 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Volume 94e157ba-eb51-4c21-820b-cd0c4abfbe06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06', 'volume_size': 1}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-793457727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e157ba-eb51-4c21-820b-cd0c4abfbe06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fa74984aac461697658f154f1d0ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:51Z,use_quota=True,user_id='f4454870f5564ac4be5ffff4a5967d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Creating volume 94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:46:51 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:46:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:51 devstack sudo[96955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 1073741824
Sep 22 15:46:51 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:51 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b3636b22-5ef9-4a98-bec2-993dc96356c1" returned: 0 in 0.632s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Lock "cinder-quobyte-b3636b22-5ef9-4a98-bec2-993dc96356c1" released by "delete_volume" :: held 1.810s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Created reservations ['c3c0b2b5-995b-4c71-87c3-1e28082a6576', 'bf04545f-f0d0-44d4-b10c-8570d430dad8', 'ffd2c66f-63b4-419b-9e5b-0089e8f02032', 'b0b6621e-a8c5-415c-9ab0-e95ec5c0bd58'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:52 devstack sudo[96959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:46:52 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:52 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.386s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:46:52 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Deleted volume successfully.
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7b8981c-43b8-447b-ae27-00bebd21d0a0 tempest-VolumesActionsTest-321046187 None] Lock "cinder-b3636b22-5ef9-4a98-bec2-993dc96356c1-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:46:52 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 1073741824" returned: 0 in 1.080s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:53 devstack sudo[96990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06
Sep 22 15:46:53 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:53 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06" returned: 0 in 0.767s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:46:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945a97a3-c74f-41f1-a362-f3fcc7bfb394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46f3e11-0252-467b-ace1-fbde6f20a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:53 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Volume volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 (94e157ba-eb51-4c21-820b-cd0c4abfbe06): created successfully
Sep 22 15:46:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46f3e11-0252-467b-ace1-fbde6f20a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (85e4b626-f7db-4553-b67d-58aeceaf9268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3e5da526-b051-44f1-9d19-d0189fa4f74b tempest-VolumesSnapshotTestJSON-1730332229 None] Created volume successfully.
Sep 22 15:46:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Creating offline snapshot 86c2d108-a74a-4b30-8dfd-0282693b0bb8 of volume 94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:46:55 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc583fc8-6063-4bbc-b58a-c2812d464d0c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:46:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:55 devstack sudo[97014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06
Sep 22 15:46:55 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:55 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06" returned: 0 in 0.835s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:55 devstack sudo[97021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 1G
Sep 22 15:46:55 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:56 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 1G" returned: 0 in 0.629s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:56 devstack sudo[97026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8
Sep 22 15:46:56 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:57 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8" returned: 0 in 0.544s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:57 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 is being set with open permissions: ugo+rw
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:57 devstack sudo[97031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8
Sep 22 15:46:57 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:57 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8" returned: 0 in 0.429s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:57 devstack sudo[97034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.info
Sep 22 15:46:57 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (da3392a7-5e83-47b5-851a-408114f56e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009f6557-0919-4113-8ec7-be0350f24808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009f6557-0919-4113-8ec7-be0350f24808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1181124852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d154533f-1d05-4239-acb4-0cc57e6603cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:58Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c736fe1e-21ae-4c53-bd24-162fe2960775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c736fe1e-21ae-4c53-bd24-162fe2960775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354d3c09-910c-4ce1-899f-1bb2ce3460d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354d3c09-910c-4ce1-899f-1bb2ce3460d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd154533f-1d05-4239-acb4-0cc57e6603cc', 'volume_name': 'volume-d154533f-1d05-4239-acb4-0cc57e6603cc', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f997bc9f-db44-4743-8fc5-cff68658eea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f997bc9f-db44-4743-8fc5-cff68658eea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423c982f-b9de-4f07-84a4-2ec41c7b1c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:57 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Volume d154533f-1d05-4239-acb4-0cc57e6603cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d154533f-1d05-4239-acb4-0cc57e6603cc', 'volume_size': 1}
Sep 22 15:46:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:58 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.info" returned: 0 in 0.474s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:58 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.info is being set with open permissions: ugo+rw
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:58 devstack sudo[97038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.info
Sep 22 15:46:58 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:58 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.info" returned: 0 in 0.407s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.507s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1181124852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d154533f-1d05-4239-acb4-0cc57e6603cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:58Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Creating volume d154533f-1d05-4239-acb4-0cc57e6603cc {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:46:58 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:58 devstack sudo[97042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc 1073741824
Sep 22 15:46:58 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5741ee7d-e4f7-4aa0-98b4-9fe9ae600745 tempest-VolumesSnapshotTestJSON-1730332229 None] Create snapshot completed successfully
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Flow 'volume_create_manager' (06a23469-e58a-4efd-ac9a-7271a7dacc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01f5fbf-b7d8-4db0-bbfa-4f6edd864017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01f5fbf-b7d8-4db0-bbfa-4f6edd864017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1094304513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228d963f-0ce3-4fbc-bced-80990aee566f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9350e7c4f13148adba520719dc69d941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:59Z,use_quota=True,user_id='bc359daf4df0438e9058c60261a0ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f0c015-b22f-4f67-a63e-4fba7e4d0535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f0c015-b22f-4f67-a63e-4fba7e4d0535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f77f8a6-5658-4c19-8eae-4399c1ae17a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:46:59 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc 1073741824" returned: 0 in 0.549s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:46:59 devstack sudo[97048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc
Sep 22 15:46:59 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:46:59 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc" returned: 0 in 0.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423c982f-b9de-4f07-84a4-2ec41c7b1c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d154533f-1d05-4239-acb4-0cc57e6603cc', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2e8a12-9ecd-4809-b79c-af969e71ef2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f77f8a6-5658-4c19-8eae-4399c1ae17a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '228d963f-0ce3-4fbc-bced-80990aee566f', 'volume_name': 'volume-228d963f-0ce3-4fbc-bced-80990aee566f', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd33dab6b0>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3494f4e-74ee-4b88-b20f-0f97f3bfe764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3494f4e-74ee-4b88-b20f-0f97f3bfe764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac24c1da-8515-4212-b193-f29cbe0242eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:46:59 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Volume 228d963f-0ce3-4fbc-bced-80990aee566f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-228d963f-0ce3-4fbc-bced-80990aee566f', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd33dab6b0>}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Trying to clone 228d963f-0ce3-4fbc-bced-80990aee566f from image a1740871-5367-428b-bac9-1a5ec1bb8377 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:46:59 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Volume volume-d154533f-1d05-4239-acb4-0cc57e6603cc (d154533f-1d05-4239-acb4-0cc57e6603cc): created successfully
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2e8a12-9ecd-4809-b79c-af969e71ef2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (da3392a7-5e83-47b5-851a-408114f56e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:46:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d32a1048-13db-48d1-9909-67e5add468cb tempest-VolumesActionsTest-321046187 None] Created volume successfully.
Sep 22 15:46:59 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:46:59 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Image download 20.69 MB at 20.69 MB/s
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e9f59c-b998-42ee-b7b4-14bbaf177144]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:00 devstack sudo[97053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD
Sep 22 15:47:00 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "cinder-d154533f-1d05-4239-acb4-0cc57e6603cc-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-d154533f-1d05-4239-acb4-0cc57e6603cc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (dca13fc8-c8c4-4967-a38b-d3ded2b5df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e83f5ee-f3a8-40e6-9e64-a37bcddd4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e83f5ee-f3a8-40e6-9e64-a37bcddd4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-741519468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad29a4ef-c821-4317-bde5-b840172c6b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fa74984aac461697658f154f1d0ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=86c2d108-a74a-4b30-8dfd-0282693b0bb8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:00Z,use_quota=True,user_id='f4454870f5564ac4be5ffff4a5967d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dadbf3-4f86-4dd5-83f8-104e294026ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dadbf3-4f86-4dd5-83f8-104e294026ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc93abcb-9e44-41fc-8f8d-38d78e66dcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc93abcb-9e44-41fc-8f8d-38d78e66dcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad29a4ef-c821-4317-bde5-b840172c6b60', 'volume_name': 'volume-ad29a4ef-c821-4317-bde5-b840172c6b60', 'volume_size': 2, 'snapshot_id': '86c2d108-a74a-4b30-8dfd-0282693b0bb8'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf562a1-b57f-4207-986f-9cead719a4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf562a1-b57f-4207-986f-9cead719a4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f058caf-757e-4a67-bf59-07da617a2998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:00 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Volume ad29a4ef-c821-4317-bde5-b840172c6b60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad29a4ef-c821-4317-bde5-b840172c6b60', 'volume_size': 2, 'snapshot_id': '86c2d108-a74a-4b30-8dfd-0282693b0bb8'}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "cinder-quobyte-d154533f-1d05-4239-acb4-0cc57e6603cc" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-86c2d108-a74a-4b30-8dfd-0282693b0bb8-ad29a4ef-c821-4317-bde5-b840172c6b60" by "_create_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-86c2d108-a74a-4b30-8dfd-0282693b0bb8-ad29a4ef-c821-4317-bde5-b840172c6b60" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Creating volume ad29a4ef-c821-4317-bde5-b840172c6b60 from snapshot 86c2d108-a74a-4b30-8dfd-0282693b0bb8 {{(pid=85987) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-ad29a4ef-c821-4317-bde5-b840172c6b60" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:00 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-quobyte-d154533f-1d05-4239-acb4-0cc57e6603cc" acquired by "delete_volume" :: waited 0.043s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 is fetched for user bc359daf4df0438e9058c60261a0ab27. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-ad29a4ef-c821-4317-bde5-b840172c6b60" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] snapshot: 86c2d108-a74a-4b30-8dfd-0282693b0bb8, volume: ad29a4ef-c821-4317-bde5-b840172c6b60,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abb66ad-e3a9-4fc0-a825-c8bffa5c073a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a492b69-19c2-42cb-bf0f-7002fa70a61e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f1ecd6-fdd3-4778-b2bb-70bbb21ee422]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:00 devstack sudo[97059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc
Sep 22 15:47:00 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:00 devstack sudo[97060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8
Sep 22 15:47:00 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:00 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD
Sep 22 15:47:00 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:00 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc" returned: 0 in 0.446s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:01 devstack sudo[97069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc
Sep 22 15:47:01 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:01 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8" returned: 0 in 0.462s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:47:01 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b590e441-b5e7-4c09-9d2f-61a9a3491691]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:01 devstack sudo[97079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06
Sep 22 15:47:01 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:01 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d154533f-1d05-4239-acb4-0cc57e6603cc" returned: 0 in 0.280s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-quobyte-d154533f-1d05-4239-acb4-0cc57e6603cc" released by "delete_volume" :: held 0.785s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Created reservations ['de0725c1-1da2-462d-9135-f764f40bf4a2', 'b8c5568c-eaf7-42ae-a2bc-6f7649e22e83', '6b5a8d53-1442-4496-8555-cebbc9fbb0c9', '8cd1ee3b-65ee-4ac1-a25c-253867137634'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:01 devstack sudo[97082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:01 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:01 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06" returned: 0 in 0.454s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60 not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:01 devstack sudo[97087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60
Sep 22 15:47:01 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:01 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.323s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:01 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Deleted volume successfully.
Sep 22 15:47:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25294c88-55dd-4cd1-b223-e7037a26d9e1 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-d154533f-1d05-4239-acb4-0cc57e6603cc-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (5598e9e1-5c2b-47d6-9d2d-43a1009590ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336c3601-4322-4135-aeaa-8c0cb3ff51db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336c3601-4322-4135-aeaa-8c0cb3ff51db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789169015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acecd5da-267d-4705-846c-f2aabacc35a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:02Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1177912d-12d8-4245-883a-c7d7a6100688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1177912d-12d8-4245-883a-c7d7a6100688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038a1c44-3b3d-4c57-9599-c44981ddb2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038a1c44-3b3d-4c57-9599-c44981ddb2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acecd5da-267d-4705-846c-f2aabacc35a1', 'volume_name': 'volume-acecd5da-267d-4705-846c-f2aabacc35a1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86433b56-f785-4bdf-91d9-c2c298aaf1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86433b56-f785-4bdf-91d9-c2c298aaf1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb0052d-b894-48b4-a46b-dda4ca96f433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:02 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Volume acecd5da-267d-4705-846c-f2aabacc35a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acecd5da-267d-4705-846c-f2aabacc35a1', 'volume_size': 1}
Sep 22 15:47:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:08 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60" returned: 0 in 6.871s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:47:08 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Converted 1024.00 MB image at 149.01 MB/s
Sep 22 15:47:08 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60 is being set with open permissions: ugo+rw
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:08 devstack sudo[97157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60
Sep 22 15:47:08 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:08 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60" returned: 0 in 0.255s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-ad29a4ef-c821-4317-bde5-b840172c6b60" released by "_copy_volume_from_snapshot" :: held 8.196s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-86c2d108-a74a-4b30-8dfd-0282693b0bb8-ad29a4ef-c821-4317-bde5-b840172c6b60" released by "_create_volume_from_snapshot" :: held 8.284s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.308s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.663s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1094304513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228d963f-0ce3-4fbc-bced-80990aee566f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9350e7c4f13148adba520719dc69d941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:46:59Z,use_quota=True,user_id='bc359daf4df0438e9058c60261a0ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Creating volume 228d963f-0ce3-4fbc-bced-80990aee566f {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:08 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:08 devstack sudo[97160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f 1073741824
Sep 22 15:47:08 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f058caf-757e-4a67-bf59-07da617a2998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad29a4ef-c821-4317-bde5-b840172c6b60', 'volume_size': 2, 'snapshot_id': '86c2d108-a74a-4b30-8dfd-0282693b0bb8'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007f5805-00a9-4582-9102-01ff4e593780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:08 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Volume volume-ad29a4ef-c821-4317-bde5-b840172c6b60 (ad29a4ef-c821-4317-bde5-b840172c6b60): created successfully
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007f5805-00a9-4582-9102-01ff4e593780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (dca13fc8-c8c4-4967-a38b-d3ded2b5df7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:08 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-61d9217a-4b70-40c4-84fb-51f1c933caf1 tempest-VolumesSnapshotTestJSON-1730332229 None] Created volume successfully.
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-ad29a4ef-c821-4317-bde5-b840172c6b60-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-ad29a4ef-c821-4317-bde5-b840172c6b60-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-ad29a4ef-c821-4317-bde5-b840172c6b60" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-ad29a4ef-c821-4317-bde5-b840172c6b60" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb86c5e-d4db-421b-b8ab-c8aa23be723e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:09 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f 1073741824" returned: 0 in 0.490s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:09 devstack sudo[97166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60
Sep 22 15:47:09 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:09 devstack sudo[97167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f
Sep 22 15:47:09 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:09 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f" returned: 0 in 0.262s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.114s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789169015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acecd5da-267d-4705-846c-f2aabacc35a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:02Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Creating volume acecd5da-267d-4705-846c-f2aabacc35a1 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:09 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:09 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60" returned: 0 in 0.404s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:09 devstack sudo[97174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1 1073741824
Sep 22 15:47:09 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:09 devstack sudo[97176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60
Sep 22 15:47:09 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Attempting download of a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 228d963f-0ce3-4fbc-bced-80990aee566f. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3db8260-2638-4992-9f7d-45895d1614f0]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_p5dl1xse {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:09 devstack sudo[97178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_p5dl1xse
Sep 22 15:47:09 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:09 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ad29a4ef-c821-4317-bde5-b840172c6b60" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-ad29a4ef-c821-4317-bde5-b840172c6b60" released by "delete_volume" :: held 0.729s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:09 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Created reservations ['f47870a7-83b8-419a-bc3f-7c1f7ac414a6', '78496a0f-1673-4346-b489-8a8c288b471b', 'a96faf4c-517f-47c8-b7ce-62a375c57718', 'e6d1fd8a-1b10-4fa8-a7f8-527c66e8b0dc'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:10 devstack sudo[97186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:10 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:10 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_p5dl1xse" returned: 0 in 0.379s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_p5dl1xse {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:10 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1 1073741824" returned: 0 in 0.521s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:10 devstack sudo[97191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1
Sep 22 15:47:10 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:10 devstack sudo[97190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_p5dl1xse
Sep 22 15:47:10 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:10 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.302s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Deleted volume successfully.
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-86c2d108-a74a-4b30-8dfd-0282693b0bb8-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-86c2d108-a74a-4b30-8dfd-0282693b0bb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-94e157ba-eb51-4c21-820b-cd0c4abfbe06" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-49c78aa7-18c4-4513-bed8-6b12aecf249c tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-ad29a4ef-c821-4317-bde5-b840172c6b60-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-94e157ba-eb51-4c21-820b-cd0c4abfbe06" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-86c2d108-a74a-4b30-8dfd-0282693b0bb8" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-86c2d108-a74a-4b30-8dfd-0282693b0bb8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Deleting offline snapshot 86c2d108-a74a-4b30-8dfd-0282693b0bb8 of volume 94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:47:10 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] snapshot_file for this snap is: volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1" returned: 0 in 0.325s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb0052d-b894-48b4-a46b-dda4ca96f433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acecd5da-267d-4705-846c-f2aabacc35a1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:10 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1414f02-e69b-4876-b965-289b503aeada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[78afc706-2024-4046-be49-727fa748e52d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_p5dl1xse" returned: 1 in 0.430s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_p5dl1xse' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4729b226-ad13-46e0-a10e-81c9558f218c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:10 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Volume volume-acecd5da-267d-4705-846c-f2aabacc35a1 (acecd5da-267d-4705-846c-f2aabacc35a1): created successfully
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1414f02-e69b-4876-b965-289b503aeada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (5598e9e1-5c2b-47d6-9d2d-43a1009590ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2d1f185d-0e15-414e-8cc1-455262929aa4 tempest-VolumesActionsTest-321046187 None] Created volume successfully.
Sep 22 15:47:10 devstack sudo[97198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8
Sep 22 15:47:10 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:10 devstack sudo[97199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD
Sep 22 15:47:10 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:10 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8" returned: 0 in 0.377s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:47:10 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] a1740871-5367-428b-bac9-1a5ec1bb8377 was qcow2, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1502bfcc-64e7-41b3-997a-0a35ed0c8a36]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:10 devstack sudo[97209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f
Sep 22 15:47:10 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:11 devstack sudo[97210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06
Sep 22 15:47:11 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Acquiring lock "cinder-acecd5da-267d-4705-846c-f2aabacc35a1-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Lock "cinder-acecd5da-267d-4705-846c-f2aabacc35a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Acquiring lock "cinder-quobyte-acecd5da-267d-4705-846c-f2aabacc35a1" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Lock "cinder-quobyte-acecd5da-267d-4705-846c-f2aabacc35a1" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c97a42d-066d-423e-9868-061906da9f09]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:11 devstack sudo[97216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1
Sep 22 15:47:11 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:11 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06" returned: 0 in 0.666s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:11 devstack sudo[97225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8
Sep 22 15:47:11 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:11 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1" returned: 0 in 0.459s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:11 devstack sudo[97228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1
Sep 22 15:47:11 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:12 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acecd5da-267d-4705-846c-f2aabacc35a1" returned: 0 in 0.334s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Lock "cinder-quobyte-acecd5da-267d-4705-846c-f2aabacc35a1" released by "delete_volume" :: held 0.846s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Created reservations ['76c408e1-f79f-4fb1-9e58-8bcf128d85a3', 'fa88d565-3640-4e98-b533-8077afcbedc7', '622f010d-15b7-4c37-9345-79c05eb6cb63', '111e73c8-9b2f-4c96-a11d-3d609c15b1bc'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:12 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8" returned: 0 in 0.520s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:12 devstack sudo[97235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8
Sep 22 15:47:12 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:12 devstack sudo[97237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:12 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:12 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06.86c2d108-a74a-4b30-8dfd-0282693b0bb8" returned: 0 in 0.406s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-86c2d108-a74a-4b30-8dfd-0282693b0bb8" released by "_delete_snapshot" :: held 2.150s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-94e157ba-eb51-4c21-820b-cd0c4abfbe06" released by "delete_snapshot" :: held 2.185s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:12 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.386s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:12 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Deleted volume successfully.
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1a9f6e54-401b-4e88-a2ad-e061e4bfc41b tempest-VolumesActionsTest-1197755678 None] Lock "cinder-acecd5da-267d-4705-846c-f2aabacc35a1-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Created reservations ['0ecb74cc-2170-4d30-8afe-69954555fe8d', '962dcb27-a9d8-4600-8010-be49ea4deb08', 'b829824f-b24f-4a21-8e88-2f679378c509', 'd0f204e2-dbdd-4038-818a-9b5b201a9bee'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:12 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Delete snapshot completed successfully.
Sep 22 15:47:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2284963-290f-4bce-a268-af0bd1f5e234 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-86c2d108-a74a-4b30-8dfd-0282693b0bb8-delete_snapshot" released by "delete_snapshot" :: held 2.396s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (6dcaef48-cb1a-4756-a90e-2d565f33b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5995ec-495f-46d3-b138-6bbdff785c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5995ec-495f-46d3-b138-6bbdff785c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-619416939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da6175d-3b15-4bab-8803-9d1c2edb0e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:13Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4de2db-acd4-4231-8ade-bfcf89bfd48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4de2db-acd4-4231-8ade-bfcf89bfd48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512c08f4-ea6d-4b68-bf51-8ef35ecadeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512c08f4-ea6d-4b68-bf51-8ef35ecadeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da6175d-3b15-4bab-8803-9d1c2edb0e28', 'volume_name': 'volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db680c0a-1ff7-40df-b649-68c1a68abd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db680c0a-1ff7-40df-b649-68c1a68abd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5722d26-f9ce-43bb-bb3e-8a0018f3a3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Volume 0da6175d-3b15-4bab-8803-9d1c2edb0e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28', 'volume_size': 1}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-619416939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da6175d-3b15-4bab-8803-9d1c2edb0e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:13Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Creating volume 0da6175d-3b15-4bab-8803-9d1c2edb0e28 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:13 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:13 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:13 devstack sudo[97241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28 1073741824
Sep 22 15:47:13 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f" returned: 0 in 2.341s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_ffj5n2gtdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:47:13 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Converted 112.00 MB image at 47.81 MB/s
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:13 devstack sudo[97243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f 1G
Sep 22 15:47:13 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:13 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f 1G" returned: 0 in 0.353s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Downloaded image a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 228d963f-0ce3-4fbc-bced-80990aee566f successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 for user bc359daf4df0438e9058c60261a0ab27 is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Marking volume 228d963f-0ce3-4fbc-bced-80990aee566f as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Copying metadata from image a1740871-5367-428b-bac9-1a5ec1bb8377 to 228d963f-0ce3-4fbc-bced-80990aee566f. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Creating volume glance metadata for volume 228d963f-0ce3-4fbc-bced-80990aee566f backed by image a1740871-5367-428b-bac9-1a5ec1bb8377 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:47:13 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28 1073741824" returned: 0 in 0.478s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-94e157ba-eb51-4c21-820b-cd0c4abfbe06-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:13 devstack sudo[97253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28
Sep 22 15:47:13 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac24c1da-8515-4212-b193-f29cbe0242eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228d963f-0ce3-4fbc-bced-80990aee566f', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd33dab6b0>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c71a51-6b3e-471f-8ecb-a5553f8cc7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-94e157ba-eb51-4c21-820b-cd0c4abfbe06-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Volume volume-228d963f-0ce3-4fbc-bced-80990aee566f (228d963f-0ce3-4fbc-bced-80990aee566f): created successfully
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c71a51-6b3e-471f-8ecb-a5553f8cc7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Flow 'volume_create_manager' (06a23469-e58a-4efd-ac9a-7271a7dacc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-94e157ba-eb51-4c21-820b-cd0c4abfbe06" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-975b8119-4392-49aa-ae38-b825ec400316 tempest-VolumesImageMetadata-1046298489 None] Created volume successfully.
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-94e157ba-eb51-4c21-820b-cd0c4abfbe06" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[830bfb93-183e-490e-a959-5fe27684fc43]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:14 devstack sudo[97255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06
Sep 22 15:47:14 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:14 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28" returned: 0 in 0.345s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5722d26-f9ce-43bb-bb3e-8a0018f3a3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3f9e29-c1d6-47bb-8b37-0fa0795bb336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:14 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Volume volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28 (0da6175d-3b15-4bab-8803-9d1c2edb0e28): created successfully
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3f9e29-c1d6-47bb-8b37-0fa0795bb336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (6dcaef48-cb1a-4756-a90e-2d565f33b73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-29a4a406-ce71-4a34-8e2d-3ad415b43a3c tempest-VolumesActionsTest-321046187 None] Created volume successfully.
Sep 22 15:47:14 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06" returned: 0 in 0.447s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:14 devstack sudo[97262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06
Sep 22 15:47:14 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Acquiring lock "cinder-228d963f-0ce3-4fbc-bced-80990aee566f-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Lock "cinder-228d963f-0ce3-4fbc-bced-80990aee566f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:14 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Acquiring lock "cinder-quobyte-228d963f-0ce3-4fbc-bced-80990aee566f" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-94e157ba-eb51-4c21-820b-cd0c4abfbe06" returned: 0 in 0.307s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-94e157ba-eb51-4c21-820b-cd0c4abfbe06" released by "delete_volume" :: held 0.825s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Lock "cinder-quobyte-228d963f-0ce3-4fbc-bced-80990aee566f" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddaba1e-7012-4a3c-90f6-b0e65c9ce938]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Created reservations ['99b0c5b2-385a-452e-a326-5c738d0ff2bf', '1709f4c1-5ad7-45b3-973a-0c3fa0657757', '73c9555a-9b33-4ac3-b79f-eb47f995825e', '78df1656-a459-4aba-b6d6-a099ec25cc5e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:14 devstack sudo[97265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f
Sep 22 15:47:14 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:14 devstack sudo[97267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:14 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:15 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Deleted volume successfully.
Sep 22 15:47:15 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f" returned: 0 in 0.466s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c2bb46a2-45e2-4dda-b96b-ca93d306120a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-94e157ba-eb51-4c21-820b-cd0c4abfbe06-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:15 devstack sudo[97273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f
Sep 22 15:47:15 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "cinder-0da6175d-3b15-4bab-8803-9d1c2edb0e28-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-0da6175d-3b15-4bab-8803-9d1c2edb0e28-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "cinder-quobyte-0da6175d-3b15-4bab-8803-9d1c2edb0e28" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-quobyte-0da6175d-3b15-4bab-8803-9d1c2edb0e28" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bc1916-f49f-45d0-9df1-0d2209bd1e90]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:15 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-228d963f-0ce3-4fbc-bced-80990aee566f" returned: 0 in 0.316s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Lock "cinder-quobyte-228d963f-0ce3-4fbc-bced-80990aee566f" released by "delete_volume" :: held 0.837s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:15 devstack sudo[97276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28
Sep 22 15:47:15 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (3b41917f-69cc-4d60-b846-ad4b605d55a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a89e34-85bd-468a-b923-f0e9eb19e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a89e34-85bd-468a-b923-f0e9eb19e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-995612205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6b7a63-a85a-4ca7-a824-0dda891907dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fa74984aac461697658f154f1d0ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:16Z,use_quota=True,user_id='f4454870f5564ac4be5ffff4a5967d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8247ff4f-d8e1-4324-8865-90fb7382525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8247ff4f-d8e1-4324-8865-90fb7382525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cbdfb4-ccf4-44a9-b3c2-83372b57c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cbdfb4-ccf4-44a9-b3c2-83372b57c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b6b7a63-a85a-4ca7-a824-0dda891907dc', 'volume_name': 'volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ae41ce-fe89-4363-a6a2-ff7530a260d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ae41ce-fe89-4363-a6a2-ff7530a260d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9514ca-13e9-4819-b070-124c72d34ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:15 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Volume 7b6b7a63-a85a-4ca7-a824-0dda891907dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc', 'volume_size': 1}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-995612205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6b7a63-a85a-4ca7-a824-0dda891907dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fa74984aac461697658f154f1d0ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:16Z,use_quota=True,user_id='f4454870f5564ac4be5ffff4a5967d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Creating volume 7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:15 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Created reservations ['dd23c190-bea2-4162-8e46-769dca6221b1', 'b59cae13-4dc0-4be0-8b2b-611c26bb22e8', 'e42de098-70ec-4966-9e95-ac2eb66d991d', 'c661fcc7-4e13-4359-a580-871371df8718'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:15 devstack sudo[97278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc 1073741824
Sep 22 15:47:15 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:15 devstack sudo[97280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:15 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:15 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28" returned: 0 in 0.417s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:15 devstack sudo[97285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28
Sep 22 15:47:15 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:16 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.273s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Deleted volume successfully.
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8da3b121-64d9-48ed-81e4-07a74aca3477 tempest-VolumesImageMetadata-1046298489 None] Lock "cinder-228d963f-0ce3-4fbc-bced-80990aee566f-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:16 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc 1073741824" returned: 0 in 0.504s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:16 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0da6175d-3b15-4bab-8803-9d1c2edb0e28" returned: 0 in 0.323s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:16 devstack sudo[97293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc
Sep 22 15:47:16 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-quobyte-0da6175d-3b15-4bab-8803-9d1c2edb0e28" released by "delete_volume" :: held 0.790s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Created reservations ['15b2f91b-7d3d-42f4-8e2e-1fba25097f1f', 'ca810798-bf54-4179-9694-b4994abc09af', '51a4572a-c702-4c95-b19b-4c637f8117a4', 'bc7f2679-6db2-4f2e-a8b1-660e33493d14'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:16 devstack sudo[97295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:16 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:16 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc" returned: 0 in 0.263s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9514ca-13e9-4819-b070-124c72d34ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ac4ec2-e324-4221-a02b-fac7bbbf393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:16 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Volume volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc (7b6b7a63-a85a-4ca7-a824-0dda891907dc): created successfully
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ac4ec2-e324-4221-a02b-fac7bbbf393b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (3b41917f-69cc-4d60-b846-ad4b605d55a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c483a0fc-54bb-4342-bbb3-63add9a3b358 tempest-VolumesSnapshotTestJSON-1730332229 None] Created volume successfully.
Sep 22 15:47:16 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.278s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Deleted volume successfully.
Sep 22 15:47:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e8d21786-a9d3-4276-b345-0e11f7eaa6a1 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-0da6175d-3b15-4bab-8803-9d1c2edb0e28-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (0ed433fe-7ada-4e05-887f-e00b60f59192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76915e85-2a8e-4bd3-a6cc-088f13fe5e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76915e85-2a8e-4bd3-a6cc-088f13fe5e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-979036516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dec997-c491-4c39-bc13-ae727c19ffa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:17Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fc2478-dd6c-4e7e-bc34-287e48b0160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fc2478-dd6c-4e7e-bc34-287e48b0160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fb9528-3e66-40ba-9e6b-70adc66bbe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fb9528-3e66-40ba-9e6b-70adc66bbe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17dec997-c491-4c39-bc13-ae727c19ffa8', 'volume_name': 'volume-17dec997-c491-4c39-bc13-ae727c19ffa8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc6b7d5-b7f1-4222-9506-c428f0b1aba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc6b7d5-b7f1-4222-9506-c428f0b1aba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9231e396-d7dc-4fdd-b03e-4fc57c417f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:17 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Volume 17dec997-c491-4c39-bc13-ae727c19ffa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17dec997-c491-4c39-bc13-ae727c19ffa8', 'volume_size': 1}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-979036516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dec997-c491-4c39-bc13-ae727c19ffa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:17Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Creating volume 17dec997-c491-4c39-bc13-ae727c19ffa8 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:17 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:17 devstack sudo[97299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8 1073741824
Sep 22 15:47:17 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:17 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8 1073741824" returned: 0 in 0.523s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:17 devstack sudo[97305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8
Sep 22 15:47:17 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:18 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8" returned: 0 in 0.327s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.248s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9231e396-d7dc-4fdd-b03e-4fc57c417f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17dec997-c491-4c39-bc13-ae727c19ffa8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c96be5-d9b4-4858-870d-9ac80ffd3e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Creating offline snapshot 88cf2b93-c8df-44cc-851d-4e201489fcb6 of volume 7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:47:18 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Volume volume-17dec997-c491-4c39-bc13-ae727c19ffa8 (17dec997-c491-4c39-bc13-ae727c19ffa8): created successfully
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c96be5-d9b4-4858-870d-9ac80ffd3e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (0ed433fe-7ada-4e05-887f-e00b60f59192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d1db53-cff5-4654-bfec-113c43cbcc3c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a1327db4-6915-464b-b394-c1ef7409e38c tempest-VolumesActionsTest-321046187 None] Created volume successfully.
Sep 22 15:47:18 devstack sudo[97312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc
Sep 22 15:47:18 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:18 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc" returned: 0 in 0.421s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:18 devstack sudo[97320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 1G
Sep 22 15:47:18 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-77188ceb-d9cf-4006-9b88-68a9a1128e5e req-edbfed04-e35a-41e4-a04e-d584172037ed tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:19 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 1G" returned: 0 in 0.576s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:19 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6
Sep 22 15:47:19 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "cinder-17dec997-c491-4c39-bc13-ae727c19ffa8-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-17dec997-c491-4c39-bc13-ae727c19ffa8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=160,cinder:SELECT=122,cinder:INSERT=42,cinder:DELETE=15 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "cinder-quobyte-17dec997-c491-4c39-bc13-ae727c19ffa8" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-quobyte-17dec997-c491-4c39-bc13-ae727c19ffa8" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:19 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6" returned: 0 in 0.358s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:19 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 is being set with open permissions: ugo+rw
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3930e0-5093-4961-95ba-70aaa1baec94]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:19 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6
Sep 22 15:47:19 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:19 devstack sudo[97342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8
Sep 22 15:47:19 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:19 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6" returned: 0 in 0.254s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=136,cinder:UPDATE=147,cinder:DELETE=13,cinder:INSERT=42 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:47:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:19 devstack sudo[97346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.info
Sep 22 15:47:19 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:20 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8" returned: 0 in 0.441s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:20 devstack sudo[97351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8
Sep 22 15:47:20 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:20 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.info" returned: 0 in 0.294s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:20 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.info is being set with open permissions: ugo+rw
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:20 devstack sudo[97355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.info
Sep 22 15:47:20 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:20 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-17dec997-c491-4c39-bc13-ae727c19ffa8" returned: 0 in 0.273s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-quobyte-17dec997-c491-4c39-bc13-ae727c19ffa8" released by "delete_volume" :: held 0.784s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Created reservations ['b20096f5-da83-40cd-a18c-d9343b50e958', 'd697e9ca-befd-4b46-9bf0-f0520881c8d4', 'b71f3762-58de-4636-9dae-df784b0e4fb0', 'bc9a3921-3e76-498f-b71b-405fb7bf46e7'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:20 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.info" returned: 0 in 0.303s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:20 devstack sudo[97359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:20 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-77188ceb-d9cf-4006-9b88-68a9a1128e5e req-edbfed04-e35a-41e4-a04e-d584172037ed tempest-TestStampPattern-819849900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.360s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-77188ceb-d9cf-4006-9b88-68a9a1128e5e req-edbfed04-e35a-41e4-a04e-d584172037ed tempest-TestStampPattern-819849900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bcef8a18-fbb6-450d-9b8f-0fa4863404e5 tempest-VolumesSnapshotTestJSON-1730332229 None] Create snapshot completed successfully
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-77188ceb-d9cf-4006-9b88-68a9a1128e5e req-edbfed04-e35a-41e4-a04e-d584172037ed tempest-TestStampPattern-819849900 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-ef8f0793-1294-4a45-9820-7b37cb7484cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37778925-931d-4d67-8534-388d4682b004', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:47:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-77188ceb-d9cf-4006-9b88-68a9a1128e5e req-edbfed04-e35a-41e4-a04e-d584172037ed tempest-TestStampPattern-819849900 None] attachment_update completed successfully.
Sep 22 15:47:20 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.323s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Deleted volume successfully.
Sep 22 15:47:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-23e1b524-2c7e-41d7-9764-023085b8cdc6 tempest-VolumesActionsTest-1197755678 None] Lock "cinder-17dec997-c491-4c39-bc13-ae727c19ffa8-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Flow 'volume_create_manager' (46d0d31e-814d-4e7a-bd9a-184dffdf967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01680faf-8b69-49d1-b564-08bb02d8caf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01680faf-8b69-49d1-b564-08bb02d8caf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-817039635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8042a5b9-675e-48d3-9150-a8bffd85111a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37166ad3b357441b9b244d852936db0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:21Z,use_quota=True,user_id='6484b2bfc6d946ac83dc0205b9314b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ef926d-5b90-42f1-bb06-00827a06b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ef926d-5b90-42f1-bb06-00827a06b934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a26495c-405e-49df-ab35-43d0f08ca2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a26495c-405e-49df-ab35-43d0f08ca2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8042a5b9-675e-48d3-9150-a8bffd85111a', 'volume_name': 'volume-8042a5b9-675e-48d3-9150-a8bffd85111a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dab62b-029e-4501-ba3f-54d89794b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dab62b-029e-4501-ba3f-54d89794b888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fbbb08-7fa0-437e-87b0-608530a30cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Volume 8042a5b9-675e-48d3-9150-a8bffd85111a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8042a5b9-675e-48d3-9150-a8bffd85111a', 'volume_size': 1}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-817039635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8042a5b9-675e-48d3-9150-a8bffd85111a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37166ad3b357441b9b244d852936db0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:21Z,use_quota=True,user_id='6484b2bfc6d946ac83dc0205b9314b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Creating volume 8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:21 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:21 devstack sudo[97774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a 1073741824
Sep 22 15:47:21 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (3f6d1a83-7de5-4864-a8a4-b74dbb9e7381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bceeb6-a33e-4689-9d45-4152adb3f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bceeb6-a33e-4689-9d45-4152adb3f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-267834792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c45639d-786a-4b9c-9426-dc7c1ae99c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:22Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f48ac56-dd97-423a-b6a4-5039795b0839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f48ac56-dd97-423a-b6a4-5039795b0839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8577cd32-c05a-4b12-ac1e-ba75f74f05c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8577cd32-c05a-4b12-ac1e-ba75f74f05c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c45639d-786a-4b9c-9426-dc7c1ae99c1d', 'volume_name': 'volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43eb4b23-4806-4d9a-bc67-4261a2b038e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43eb4b23-4806-4d9a-bc67-4261a2b038e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ded27f-828e-4c6f-9939-6e358213a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Volume 9c45639d-786a-4b9c-9426-dc7c1ae99c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d', 'volume_size': 1}
Sep 22 15:47:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (5455e032-2cca-491e-b2a0-e408643e464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6f99c6-8cbb-4190-b1fe-7ae146c375cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6f99c6-8cbb-4190-b1fe-7ae146c375cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-896979108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7facba90-ffff-421e-b1c3-30e6ea7dbc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fa74984aac461697658f154f1d0ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=88cf2b93-c8df-44cc-851d-4e201489fcb6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:22Z,use_quota=True,user_id='f4454870f5564ac4be5ffff4a5967d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e551abbf-4498-42b5-9729-1742831ac402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e551abbf-4498-42b5-9729-1742831ac402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf10112-9fcc-4966-a66e-70c34d42c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf10112-9fcc-4966-a66e-70c34d42c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7facba90-ffff-421e-b1c3-30e6ea7dbc64', 'volume_name': 'volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64', 'volume_size': 1, 'snapshot_id': '88cf2b93-c8df-44cc-851d-4e201489fcb6'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9decc9-125c-4e57-a06c-b216f5526e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9decc9-125c-4e57-a06c-b216f5526e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274aa265-7663-4f4a-bf93-4d6bb2bb012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:22 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Volume 7facba90-ffff-421e-b1c3-30e6ea7dbc64: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64', 'volume_size': 1, 'snapshot_id': '88cf2b93-c8df-44cc-851d-4e201489fcb6'}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:22 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a 1073741824" returned: 0 in 0.506s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:22 devstack sudo[97786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a
Sep 22 15:47:22 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:22 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a" returned: 0 in 0.257s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-267834792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c45639d-786a-4b9c-9426-dc7c1ae99c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e5ada13670490db1519d499ddd84a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:22Z,use_quota=True,user_id='cd83cd59b88e4752ba62c118aded7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Creating volume 9c45639d-786a-4b9c-9426-dc7c1ae99c1d {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:22 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:22 devstack sudo[97791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d 1073741824
Sep 22 15:47:22 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fbbb08-7fa0-437e-87b0-608530a30cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8042a5b9-675e-48d3-9150-a8bffd85111a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b968c10-d973-418d-8da8-f3f054fc1645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:22 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Volume volume-8042a5b9-675e-48d3-9150-a8bffd85111a (8042a5b9-675e-48d3-9150-a8bffd85111a): created successfully
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b968c10-d973-418d-8da8-f3f054fc1645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Flow 'volume_create_manager' (46d0d31e-814d-4e7a-bd9a-184dffdf967c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:22 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f2db351f-c249-4880-a4e3-50adf4441bf8 tempest-VolumesCloneTest-509885410 None] Created volume successfully.
Sep 22 15:47:22 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d 1073741824" returned: 0 in 0.440s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:23 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d
Sep 22 15:47:23 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:23 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.081s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-88cf2b93-c8df-44cc-851d-4e201489fcb6-7facba90-ffff-421e-b1c3-30e6ea7dbc64" by "_create_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ded27f-828e-4c6f-9939-6e358213a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac879fcf-27d5-4172-98ed-32a796dcd360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-88cf2b93-c8df-44cc-851d-4e201489fcb6-7facba90-ffff-421e-b1c3-30e6ea7dbc64" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Creating volume 7facba90-ffff-421e-b1c3-30e6ea7dbc64 from snapshot 88cf2b93-c8df-44cc-851d-4e201489fcb6 {{(pid=85987) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-7facba90-ffff-421e-b1c3-30e6ea7dbc64" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:23 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Volume volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d (9c45639d-786a-4b9c-9426-dc7c1ae99c1d): created successfully
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac879fcf-27d5-4172-98ed-32a796dcd360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Flow 'volume_create_manager' (3f6d1a83-7de5-4864-a8a4-b74dbb9e7381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-7facba90-ffff-421e-b1c3-30e6ea7dbc64" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] snapshot: 88cf2b93-c8df-44cc-851d-4e201489fcb6, volume: 7facba90-ffff-421e-b1c3-30e6ea7dbc64,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:47:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0bce6676-ea9e-4c5c-adb6-04400e421018 tempest-VolumesActionsTest-321046187 None] Created volume successfully.
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dc2cb9-054c-4f5d-93ac-aecd77b24563]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:23 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6
Sep 22 15:47:23 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:23 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6" returned: 0 in 0.555s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[009b91e4-b95d-43aa-9205-756abc0a6456]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:24 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc
Sep 22 15:47:24 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Flow 'volume_create_manager' (376b01dc-d6a7-4847-8077-43b46a3acc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83cc595-6065-4510-a8ae-02eddcc9e557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83cc595-6065-4510-a8ae-02eddcc9e557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2035043383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0662e451-72a2-43c3-a97d-c71abe81ead9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37166ad3b357441b9b244d852936db0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=8042a5b9-675e-48d3-9150-a8bffd85111a,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:24Z,use_quota=True,user_id='6484b2bfc6d946ac83dc0205b9314b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afda5162-da2a-4ea2-ba54-741564348b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afda5162-da2a-4ea2-ba54-741564348b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb275da-94d4-4879-a0e8-79ec927d5dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Acquiring lock "cinder-9c45639d-786a-4b9c-9426-dc7c1ae99c1d-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb275da-94d4-4879-a0e8-79ec927d5dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0662e451-72a2-43c3-a97d-c71abe81ead9', 'volume_name': 'volume-0662e451-72a2-43c3-a97d-c71abe81ead9', 'volume_size': 2, 'source_volid': '8042a5b9-675e-48d3-9150-a8bffd85111a', 'source_volstatus': 'available'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c732e64d-07c4-4838-bc4b-f5d933d92955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c732e64d-07c4-4838-bc4b-f5d933d92955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20564322-1d8d-4258-a7f1-2613adf99385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:24 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Volume 0662e451-72a2-43c3-a97d-c71abe81ead9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0662e451-72a2-43c3-a97d-c71abe81ead9', 'volume_size': 2, 'source_volid': '8042a5b9-675e-48d3-9150-a8bffd85111a', 'source_volstatus': 'available'}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Lock "cinder-9c45639d-786a-4b9c-9426-dc7c1ae99c1d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Acquiring lock "cinder-quobyte-9c45639d-786a-4b9c-9426-dc7c1ae99c1d" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Lock "cinder-quobyte-9c45639d-786a-4b9c-9426-dc7c1ae99c1d" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:24 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc" returned: 0 in 0.618s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64 not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d1c0b8-4006-461b-8aa1-79864c96cc63]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:24 devstack sudo[97820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64
Sep 22 15:47:24 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:24 devstack sudo[97821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d
Sep 22 15:47:24 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:25 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d" returned: 0 in 0.444s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:25 devstack sudo[97835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d
Sep 22 15:47:25 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:25 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9c45639d-786a-4b9c-9426-dc7c1ae99c1d" returned: 0 in 0.361s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Lock "cinder-quobyte-9c45639d-786a-4b9c-9426-dc7c1ae99c1d" released by "delete_volume" :: held 0.896s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Created reservations ['c66cd261-a938-4515-ba1b-862fad204579', '467020ac-4225-4d24-b5ea-bd8a6b400a10', '9041914c-836d-4cb2-8492-67ef0d794f00', '055106c5-dbe4-42e3-88dc-07e1217d7e98'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:25 devstack sudo[97853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:25 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:26 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.548s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:26 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:26 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Deleted volume successfully.
Sep 22 15:47:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3a2dbad8-ceb8-46c1-985a-5e714155c343 tempest-VolumesActionsTest-321046187 None] Lock "cinder-9c45639d-786a-4b9c-9426-dc7c1ae99c1d-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:26 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-3c577efd-5e90-40e7-8088-28e347504f06 req-92ea84f7-cad0-4851-8330-43703325889a tempest-TestStampPattern-819849900 None] Terminate volume connection completed successfully.
Sep 22 15:47:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-3c577efd-5e90-40e7-8088-28e347504f06 req-92ea84f7-cad0-4851-8330-43703325889a tempest-TestStampPattern-819849900 None] Deleting attachment 37778925-931d-4d67-8534-388d4682b004. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:47:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:47:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:28 devstack sudo[97886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:28 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:29 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.427s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:47:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:47:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:47:32 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64" returned: 0 in 7.887s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc, size 1024.00 MB, duration 7.89 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:47:32 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Converted 1024.00 MB image at 129.81 MB/s
Sep 22 15:47:32 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64 is being set with open permissions: ugo+rw
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:32 devstack sudo[97891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64
Sep 22 15:47:32 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:32 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64" returned: 0 in 0.285s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-7facba90-ffff-421e-b1c3-30e6ea7dbc64" released by "_copy_volume_from_snapshot" :: held 9.454s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-88cf2b93-c8df-44cc-851d-4e201489fcb6-7facba90-ffff-421e-b1c3-30e6ea7dbc64" released by "_create_volume_from_snapshot" :: held 9.541s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.579s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.338s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:32 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Cloning volume 8042a5b9-675e-48d3-9150-a8bffd85111a to volume 0662e451-72a2-43c3-a97d-c71abe81ead9
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274aa265-7663-4f4a-bf93-4d6bb2bb012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64', 'volume_size': 1, 'snapshot_id': '88cf2b93-c8df-44cc-851d-4e201489fcb6'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd2af96-e8dd-4909-92f5-d48d56286f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Creating offline snapshot e1ccbc08-8152-47d8-a1fa-c900ccfdb240 of volume 8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:47:32 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Volume volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64 (7facba90-ffff-421e-b1c3-30e6ea7dbc64): created successfully
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd2af96-e8dd-4909-92f5-d48d56286f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Flow 'volume_create_manager' (5455e032-2cca-491e-b2a0-e408643e464d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaff812-73c2-4476-8cd3-70351a4a4b65]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5e7c8df5-1336-47b3-8114-868e4893e491 tempest-VolumesSnapshotTestJSON-1730332229 None] Created volume successfully.
Sep 22 15:47:33 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a
Sep 22 15:47:33 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-7facba90-ffff-421e-b1c3-30e6ea7dbc64-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-7facba90-ffff-421e-b1c3-30e6ea7dbc64-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-7facba90-ffff-421e-b1c3-30e6ea7dbc64" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-7facba90-ffff-421e-b1c3-30e6ea7dbc64" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[32918bae-1c5f-4371-8cc7-bef0babe4ffa]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:33 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a" returned: 0 in 0.444s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:33 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 1G
Sep 22 15:47:33 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:33 devstack sudo[97900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64
Sep 22 15:47:33 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:33 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64" returned: 0 in 0.440s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:33 devstack sudo[97911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64
Sep 22 15:47:33 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:33 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 1G" returned: 0 in 0.490s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8042a5b9-675e-48d3-9150-a8bffd85111a -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:33 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8042a5b9-675e-48d3-9150-a8bffd85111a -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240
Sep 22 15:47:33 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:34 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7facba90-ffff-421e-b1c3-30e6ea7dbc64" returned: 0 in 0.266s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-7facba90-ffff-421e-b1c3-30e6ea7dbc64" released by "delete_volume" :: held 0.755s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Created reservations ['284afb24-195b-41fe-ba95-09f11ba283c7', '6d132710-ea4a-4d4f-ba80-9833af9ea666', '91dd2850-f21a-468a-b2ca-f75c8816eb07', '864a8f5f-6284-4717-a4a4-37a2eb633bbb'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:34 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8042a5b9-675e-48d3-9150-a8bffd85111a -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240" returned: 0 in 0.373s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:34 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 is being set with open permissions: ugo+rw
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:34 devstack sudo[97919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:34 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:34 devstack sudo[97920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240
Sep 22 15:47:34 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:34 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.286s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-88cf2b93-c8df-44cc-851d-4e201489fcb6-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:34 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Deleted volume successfully.
Sep 22 15:47:34 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-88cf2b93-c8df-44cc-851d-4e201489fcb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-7b6b7a63-a85a-4ca7-a824-0dda891907dc" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240" returned: 0 in 0.325s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c3929d6c-83d2-40ef-af69-b8d45b06b84d tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-7facba90-ffff-421e-b1c3-30e6ea7dbc64-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-7b6b7a63-a85a-4ca7-a824-0dda891907dc" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-88cf2b93-c8df-44cc-851d-4e201489fcb6" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:34 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.info
Sep 22 15:47:34 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-88cf2b93-c8df-44cc-851d-4e201489fcb6" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Deleting offline snapshot 88cf2b93-c8df-44cc-851d-4e201489fcb6 of volume 7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] snapshot_file for this snap is: volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37aa266-f00f-4df7-84b2-a151b7216d09]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:34 devstack sudo[97927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6
Sep 22 15:47:34 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:34 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.info" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:34 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.info is being set with open permissions: ugo+rw
Sep 22 15:47:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:34 devstack sudo[97930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.info
Sep 22 15:47:34 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:35 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6" returned: 0 in 0.392s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7b95e2-a718-4943-9878-ff9c188d7834]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:35 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.info" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Acquiring lock "cinder-quobyte-0662e451-72a2-43c3-a97d-c71abe81ead9" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Lock "cinder-quobyte-0662e451-72a2-43c3-a97d-c71abe81ead9" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] snapshot: e1ccbc08-8152-47d8-a1fa-c900ccfdb240, volume: 0662e451-72a2-43c3-a97d-c71abe81ead9,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:47:35 devstack sudo[97938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc
Sep 22 15:47:35 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cdd373-69f1-47f5-a7e4-d5286f74fc04]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:35 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240
Sep 22 15:47:35 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:35 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240" returned: 0 in 0.396s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8042a5b9-675e-48d3-9150-a8bffd85111a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30d137b-eab7-4596-b1c3-cd01801490d3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:35 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc" returned: 0 in 0.606s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:35 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6
Sep 22 15:47:35 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:35 devstack sudo[97948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a
Sep 22 15:47:35 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:36 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6" returned: 0 in 0.351s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:36 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a" returned: 0 in 0.382s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9 not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:36 devstack sudo[97959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6
Sep 22 15:47:36 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:36 devstack sudo[97961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9
Sep 22 15:47:36 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:36 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc.88cf2b93-c8df-44cc-851d-4e201489fcb6" returned: 0 in 0.317s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-88cf2b93-c8df-44cc-851d-4e201489fcb6" released by "_delete_snapshot" :: held 1.789s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-7b6b7a63-a85a-4ca7-a824-0dda891907dc" released by "delete_snapshot" :: held 1.832s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Created reservations ['ec0cc576-17fc-429e-b078-37a798b0e484', '981dca6f-98d9-4476-8a9c-f1a761b22c4c', 'd09ea074-a463-45ce-95db-7099c11268b6', 'cb59df40-4a46-41b9-992a-801eec3cacd8'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Delete snapshot completed successfully.
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d1da2371-6cd2-4a3b-a81b-9e6e9c312775 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-88cf2b93-c8df-44cc-851d-4e201489fcb6-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-7b6b7a63-a85a-4ca7-a824-0dda891907dc-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-7b6b7a63-a85a-4ca7-a824-0dda891907dc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-7b6b7a63-a85a-4ca7-a824-0dda891907dc" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-7b6b7a63-a85a-4ca7-a824-0dda891907dc" acquired by "delete_volume" :: waited 0.040s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:37 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c971a0-ea9b-46f3-8ef6-93ef8dbd72d4]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:37 devstack sudo[97974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc
Sep 22 15:47:37 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:37 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc" returned: 0 in 0.907s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:38 devstack sudo[97981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc
Sep 22 15:47:38 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:38 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7b6b7a63-a85a-4ca7-a824-0dda891907dc" returned: 0 in 0.460s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-7b6b7a63-a85a-4ca7-a824-0dda891907dc" released by "delete_volume" :: held 1.525s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:38 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Created reservations ['9efc54dd-9a9c-426b-89c6-756b53e57e56', 'ee37d481-ec58-4929-85cf-568cd38b308b', '7f7d6845-21f3-490a-9371-629c93f1f9ba', '26b947bf-7d98-41ba-99c1-8ffd801e987c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:38 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:38 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:39 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.461s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:39 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Deleted volume successfully.
Sep 22 15:47:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-46e62755-a633-4f52-a5c7-7f69f18926a3 tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-7b6b7a63-a85a-4ca7-a824-0dda891907dc-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-440c9e27-6289-437f-8bd8-413478501ad6-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-440c9e27-6289-437f-8bd8-413478501ad6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "cinder-quobyte-440c9e27-6289-437f-8bd8-413478501ad6" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-440c9e27-6289-437f-8bd8-413478501ad6" acquired by "delete_volume" :: waited 0.050s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[46210725-de12-47ef-97c0-299a230a3e2a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:40 devstack sudo[97988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6
Sep 22 15:47:40 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:40 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6" returned: 0 in 0.658s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:40 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6
Sep 22 15:47:40 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:41 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-440c9e27-6289-437f-8bd8-413478501ad6" returned: 0 in 0.794s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-quobyte-440c9e27-6289-437f-8bd8-413478501ad6" released by "delete_volume" :: held 1.628s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:41 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Created reservations ['02afd66b-7175-4f52-b05b-c43fe673829b', 'd443e5cc-44e0-4fb7-a2a0-1f7d8947907b', '6061b4cc-a05b-464a-acbb-6664850a41eb', '4fc65946-7e60-45b3-a3ec-59a9d7590445'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:41 devstack sudo[97998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:41 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:42 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.574s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:42 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Deleted volume successfully.
Sep 22 15:47:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-53ce9706-398e-40c2-8ee6-bfbf3231f88a tempest-VolumesSnapshotTestJSON-1730332229 None] Lock "cinder-440c9e27-6289-437f-8bd8-413478501ad6-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:44 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9" returned: 0 in 8.173s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a, size 1024.00 MB, duration 8.17 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:47:44 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Converted 1024.00 MB image at 125.28 MB/s
Sep 22 15:47:44 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9 is being set with open permissions: ugo+rw
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:44 devstack sudo[98009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9
Sep 22 15:47:44 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:44 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9" returned: 0 in 0.266s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Lock "cinder-quobyte-0662e451-72a2-43c3-a97d-c71abe81ead9" released by "_copy_volume_from_snapshot" :: held 9.322s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Acquiring lock "cinder-quobyte-e1ccbc08-8152-47d8-a1fa-c900ccfdb240" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Lock "cinder-quobyte-e1ccbc08-8152-47d8-a1fa-c900ccfdb240" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Deleting offline snapshot e1ccbc08-8152-47d8-a1fa-c900ccfdb240 of volume 8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] snapshot_file for this snap is: volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0a201d-734e-4d80-ba55-a7390320b31d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:44 devstack sudo[98012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240
Sep 22 15:47:44 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:45 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240" returned: 0 in 0.422s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8042a5b9-675e-48d3-9150-a8bffd85111a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:47:45 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[60905bfa-8cda-46e6-8be9-ae54abf91eeb]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:45 devstack sudo[98019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a
Sep 22 15:47:45 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:45 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a" returned: 0 in 0.578s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:45 devstack sudo[98025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240
Sep 22 15:47:45 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:46 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240" returned: 0 in 0.414s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:46 devstack sudo[98030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240
Sep 22 15:47:46 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:46 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a.e1ccbc08-8152-47d8-a1fa-c900ccfdb240" returned: 0 in 0.278s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Lock "cinder-quobyte-e1ccbc08-8152-47d8-a1fa-c900ccfdb240" released by "_delete_snapshot" :: held 1.807s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.610s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.506s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20564322-1d8d-4258-a7f1-2613adf99385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0662e451-72a2-43c3-a97d-c71abe81ead9', 'volume_size': 2, 'source_volid': '8042a5b9-675e-48d3-9150-a8bffd85111a', 'source_volstatus': 'available'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee097a9d-95e5-4da8-87ad-697f60960490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Creating offline snapshot e57b5f8c-f1cd-4676-a81a-46ad1fbd560a of volume ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:47:46 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Volume volume-0662e451-72a2-43c3-a97d-c71abe81ead9 (0662e451-72a2-43c3-a97d-c71abe81ead9): created successfully
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee097a9d-95e5-4da8-87ad-697f60960490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Flow 'volume_create_manager' (376b01dc-d6a7-4847-8077-43b46a3acc82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b17e3b-fde8-4365-89a1-fa9d2581dc16]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-65ab0169-46d9-48a9-90bf-f8e30012ad80 tempest-VolumesCloneTest-509885410 None] Created volume successfully.
Sep 22 15:47:46 devstack sudo[98033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb
Sep 22 15:47:46 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:46 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb" returned: 0 in 0.400s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:46 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a 1G
Sep 22 15:47:46 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:47 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a 1G" returned: 0 in 0.596s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef8f0793-1294-4a45-9820-7b37cb7484cb -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:47 devstack sudo[98045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef8f0793-1294-4a45-9820-7b37cb7484cb -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a
Sep 22 15:47:47 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:47 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef8f0793-1294-4a45-9820-7b37cb7484cb -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a" returned: 0 in 0.398s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:47 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a is being set with open permissions: ugo+rw
Sep 22 15:47:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:47 devstack sudo[98051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a
Sep 22 15:47:47 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Acquiring lock "cinder-0662e451-72a2-43c3-a97d-c71abe81ead9-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Lock "cinder-0662e451-72a2-43c3-a97d-c71abe81ead9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Acquiring lock "cinder-quobyte-0662e451-72a2-43c3-a97d-c71abe81ead9" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Lock "cinder-quobyte-0662e451-72a2-43c3-a97d-c71abe81ead9" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:48 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf76880d-b984-4e30-82b2-2e3a08f1669d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a" returned: 0 in 0.393s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:48 devstack sudo[98056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.info
Sep 22 15:47:48 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:48 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9
Sep 22 15:47:48 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:48 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.info" returned: 0 in 0.334s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:48 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.info is being set with open permissions: ugo+rw
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:48 devstack sudo[98060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.info
Sep 22 15:47:48 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:48 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9" returned: 0 in 0.552s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:48 devstack sudo[98065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9
Sep 22 15:47:48 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:48 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.info" returned: 0 in 0.292s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9301bcee-180a-444c-a247-c9f036d3dd24 tempest-TestStampPattern-819849900 None] Create snapshot completed successfully
Sep 22 15:47:49 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0662e451-72a2-43c3-a97d-c71abe81ead9" returned: 0 in 0.326s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Lock "cinder-quobyte-0662e451-72a2-43c3-a97d-c71abe81ead9" released by "delete_volume" :: held 0.942s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Created reservations ['1f5ff209-65e0-4dd2-bba1-0bd66c3227f3', '89816e3a-e164-4856-a7af-969e4170f2a1', 'e867c0be-31b1-4c5c-a883-da17415f0e09', '59d14c19-817e-4f4d-ab53-fafbe9a77cbe'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:49 devstack sudo[98069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:49 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:49 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.258s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Deleted volume successfully.
Sep 22 15:47:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-be265a86-1c29-4baf-bc57-ad0553324790 tempest-VolumesCloneTest-509885410 None] Lock "cinder-0662e451-72a2-43c3-a97d-c71abe81ead9-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Acquiring lock "cinder-8042a5b9-675e-48d3-9150-a8bffd85111a-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Lock "cinder-8042a5b9-675e-48d3-9150-a8bffd85111a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Acquiring lock "cinder-quobyte-8042a5b9-675e-48d3-9150-a8bffd85111a" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Lock "cinder-quobyte-8042a5b9-675e-48d3-9150-a8bffd85111a" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:50 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[18998d60-6249-45fd-8554-70add78430d1]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:50 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a
Sep 22 15:47:50 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:51 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a" returned: 0 in 0.476s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:51 devstack sudo[98082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a
Sep 22 15:47:51 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:51 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8042a5b9-675e-48d3-9150-a8bffd85111a" returned: 0 in 0.284s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Lock "cinder-quobyte-8042a5b9-675e-48d3-9150-a8bffd85111a" released by "delete_volume" :: held 0.868s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Created reservations ['ae1fcb8a-ad63-4e62-b066-fae3a4b02710', '4d98e8e4-edf1-47d6-9a96-4256ab3d8e08', 'bb67a782-8586-4451-9619-d26895fa008e', 'b27dd4f9-dabc-42b9-82dc-c6ac7ec1cec2'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:51 devstack sudo[98099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:47:51 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Flow 'volume_create_manager' (3fff0948-8899-431f-8e67-dba723477390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5f8035-840e-425e-92c6-685fc3e9442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5f8035-840e-425e-92c6-685fc3e9442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1437726680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cef4f3-6a95-45a7-be61-eaa1378c0868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14577ea93bb14f509e2b6b853b657a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:52Z,use_quota=True,user_id='3959c9e10c30461fac17bfa9843e964d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d7a9aa-3440-4c0d-8c59-f7100f20e454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d7a9aa-3440-4c0d-8c59-f7100f20e454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb8dd97-8329-4743-89c3-07a9b203f2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb8dd97-8329-4743-89c3-07a9b203f2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cef4f3-6a95-45a7-be61-eaa1378c0868', 'volume_name': 'volume-95cef4f3-6a95-45a7-be61-eaa1378c0868', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200383fd-ee92-470b-b8cc-94d27227b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200383fd-ee92-470b-b8cc-94d27227b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f65e40-9b0f-44fc-9fd0-abdde750fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:52 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Volume 95cef4f3-6a95-45a7-be61-eaa1378c0868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cef4f3-6a95-45a7-be61-eaa1378c0868', 'volume_size': 1}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1437726680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cef4f3-6a95-45a7-be61-eaa1378c0868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14577ea93bb14f509e2b6b853b657a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:52Z,use_quota=True,user_id='3959c9e10c30461fac17bfa9843e964d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Creating volume 95cef4f3-6a95-45a7-be61-eaa1378c0868 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:52 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:52 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.364s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:47:52 devstack sudo[98114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 1073741824
Sep 22 15:47:52 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:52 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Deleted volume successfully.
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0bd5b86f-bdb2-4ead-a5e2-a297a1199b5d tempest-VolumesCloneTest-509885410 None] Lock "cinder-8042a5b9-675e-48d3-9150-a8bffd85111a-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:47:52 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 1073741824" returned: 0 in 0.718s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:52 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868
Sep 22 15:47:52 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:53 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868" returned: 0 in 0.292s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:47:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f65e40-9b0f-44fc-9fd0-abdde750fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cef4f3-6a95-45a7-be61-eaa1378c0868', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab603aaa-0608-4d14-b3b4-bdc42a5d7eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:53 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Volume volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 (95cef4f3-6a95-45a7-be61-eaa1378c0868): created successfully
Sep 22 15:47:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab603aaa-0608-4d14-b3b4-bdc42a5d7eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Flow 'volume_create_manager' (3fff0948-8899-431f-8e67-dba723477390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-de665f94-5a12-4888-b3c0-770ca78a07ad tempest-SnapshotMetadataTestJSON-1530789544 None] Created volume successfully.
Sep 22 15:47:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Creating offline snapshot 76d654bd-9133-4195-8560-2ea6daa3a642 of volume 95cef4f3-6a95-45a7-be61-eaa1378c0868 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:47:54 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ec2e6e-2478-4540-a254-bcbc7b87fd2d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:54 devstack sudo[98130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868
Sep 22 15:47:54 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:54 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868" returned: 0 in 0.499s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:54 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 1G
Sep 22 15:47:54 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:55 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 1G" returned: 0 in 0.612s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:55 devstack sudo[98142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642
Sep 22 15:47:55 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:56 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642" returned: 0 in 0.488s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:56 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 is being set with open permissions: ugo+rw
Sep 22 15:47:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:56 devstack sudo[98149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642
Sep 22 15:47:56 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:56 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642" returned: 0 in 0.325s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:56 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.info
Sep 22 15:47:56 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:56 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.info" returned: 0 in 0.350s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:56 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.info is being set with open permissions: ugo+rw
Sep 22 15:47:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:56 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.info
Sep 22 15:47:56 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Flow 'volume_create_manager' (c5b53314-d994-4102-a1f4-affdcd7e1d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c5df71-fdc1-4e74-a0a8-c73cac1c5dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c5df71-fdc1-4e74-a0a8-c73cac1c5dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-532947211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98914e65-8b80-4e37-af4e-1973c0f12469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea380f88c09441c82bc31e04e2cb4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:57Z,use_quota=True,user_id='3e136a89f7fd4c28a45b4af0159593ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd76ee1-4bd3-415c-991e-a70799aee56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd76ee1-4bd3-415c-991e-a70799aee56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13d951b-00de-40d0-965c-1f36149bb965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13d951b-00de-40d0-965c-1f36149bb965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98914e65-8b80-4e37-af4e-1973c0f12469', 'volume_name': 'volume-98914e65-8b80-4e37-af4e-1973c0f12469', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51705c5b-b4e7-41c7-b02a-2c106691a3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51705c5b-b4e7-41c7-b02a-2c106691a3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f34935-6670-42f4-99a4-49758210dc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Volume 98914e65-8b80-4e37-af4e-1973c0f12469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98914e65-8b80-4e37-af4e-1973c0f12469', 'volume_size': 1}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.info" returned: 0 in 0.403s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-532947211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98914e65-8b80-4e37-af4e-1973c0f12469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea380f88c09441c82bc31e04e2cb4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:57Z,use_quota=True,user_id='3e136a89f7fd4c28a45b4af0159593ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Creating volume 98914e65-8b80-4e37-af4e-1973c0f12469 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:57 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:57 devstack sudo[98158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469 1073741824
Sep 22 15:47:57 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:57 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3d70ff69-53ea-48c3-993d-722cb70bb9a0 tempest-SnapshotMetadataTestJSON-1530789544 None] Create snapshot completed successfully
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Flow 'volume_create_manager' (1b261618-a51b-4ce6-a457-6c60a764cd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b90e01-226d-49df-b680-f472ae19c883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b90e01-226d-49df-b680-f472ae19c883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1054409569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8032461d-a96a-496c-9522-853d5abf8391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395d024a919f4c78bbe0eb6aceb169cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e57b5f8c-f1cd-4676-a81a-46ad1fbd560a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:47:58Z,use_quota=True,user_id='0c4ddd6671d14c0891ecdc12eea9d5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca577946-24c6-4b67-b4eb-bd20b8ddc0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca577946-24c6-4b67-b4eb-bd20b8ddc0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07998e3-f257-48da-89dc-6c9363e0a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07998e3-f257-48da-89dc-6c9363e0a45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8032461d-a96a-496c-9522-853d5abf8391', 'volume_name': 'volume-8032461d-a96a-496c-9522-853d5abf8391', 'volume_size': 1, 'snapshot_id': 'e57b5f8c-f1cd-4676-a81a-46ad1fbd560a'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ec5306-a41a-4f13-8d9b-10199f38bb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ec5306-a41a-4f13-8d9b-10199f38bb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d44f29-fae9-43bb-afda-b1dc03b6e90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:57 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Volume 8032461d-a96a-496c-9522-853d5abf8391: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8032461d-a96a-496c-9522-853d5abf8391', 'volume_size': 1, 'snapshot_id': 'e57b5f8c-f1cd-4676-a81a-46ad1fbd560a'}
Sep 22 15:47:58 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469 1073741824" returned: 0 in 0.810s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:58 devstack sudo[98164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469
Sep 22 15:47:58 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:58 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469" returned: 0 in 0.291s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.341s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Acquiring lock "cinder-quobyte-e57b5f8c-f1cd-4676-a81a-46ad1fbd560a-8032461d-a96a-496c-9522-853d5abf8391" by "_create_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f34935-6670-42f4-99a4-49758210dc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98914e65-8b80-4e37-af4e-1973c0f12469', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014b685e-e86c-46bb-9685-fb64f6b13a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:47:58 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Volume volume-98914e65-8b80-4e37-af4e-1973c0f12469 (98914e65-8b80-4e37-af4e-1973c0f12469): created successfully
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014b685e-e86c-46bb-9685-fb64f6b13a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Flow 'volume_create_manager' (c5b53314-d994-4102-a1f4-affdcd7e1d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-e57b5f8c-f1cd-4676-a81a-46ad1fbd560a-8032461d-a96a-496c-9522-853d5abf8391" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Creating volume 8032461d-a96a-496c-9522-853d5abf8391 from snapshot e57b5f8c-f1cd-4676-a81a-46ad1fbd560a {{(pid=85987) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Acquiring lock "cinder-quobyte-8032461d-a96a-496c-9522-853d5abf8391" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1cb59662-cf9c-49cb-ae4e-299a6e06abde tempest-VolumesNegativeTest-590331616 None] Created volume successfully.
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-8032461d-a96a-496c-9522-853d5abf8391" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] snapshot: e57b5f8c-f1cd-4676-a81a-46ad1fbd560a, volume: 8032461d-a96a-496c-9522-853d5abf8391,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8024083-b11d-4bee-9798-86aab05fc631]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:58 devstack sudo[98167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a
Sep 22 15:47:58 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Acquiring lock "cinder-76d654bd-9133-4195-8560-2ea6daa3a642-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-76d654bd-9133-4195-8560-2ea6daa3a642-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Acquiring lock "cinder-quobyte-95cef4f3-6a95-45a7-be61-eaa1378c0868" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-quobyte-95cef4f3-6a95-45a7-be61-eaa1378c0868" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Acquiring lock "cinder-quobyte-76d654bd-9133-4195-8560-2ea6daa3a642" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-quobyte-76d654bd-9133-4195-8560-2ea6daa3a642" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:47:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Deleting offline snapshot 76d654bd-9133-4195-8560-2ea6daa3a642 of volume 95cef4f3-6a95-45a7-be61-eaa1378c0868 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] snapshot_file for this snap is: volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b4f32-f634-495b-a705-e08c7bcfa565]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:59 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a" returned: 0 in 0.597s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef8f0793-1294-4a45-9820-7b37cb7484cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae0b489-f775-48e7-8469-57be1cbc0083]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:59 devstack sudo[98175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642
Sep 22 15:47:59 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:59 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb
Sep 22 15:47:59 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:59 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642" returned: 0 in 0.544s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95cef4f3-6a95-45a7-be61-eaa1378c0868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98d42ad-c77a-4a47-b9ce-efda4e93332c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:59 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb" returned: 0 in 0.663s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391 not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:47:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:47:59 devstack sudo[98184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868
Sep 22 15:47:59 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:47:59 devstack sudo[98187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391
Sep 22 15:47:59 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:00 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868" returned: 0 in 0.765s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:00 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642
Sep 22 15:48:00 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:01 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642" returned: 0 in 0.736s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:01 devstack sudo[98207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642
Sep 22 15:48:01 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:01 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868.76d654bd-9133-4195-8560-2ea6daa3a642" returned: 0 in 0.762s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-quobyte-76d654bd-9133-4195-8560-2ea6daa3a642" released by "_delete_snapshot" :: held 3.169s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-quobyte-95cef4f3-6a95-45a7-be61-eaa1378c0868" released by "delete_snapshot" :: held 3.234s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:02 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Created reservations ['bbbd075b-a5e2-41ce-ae1d-f83d14fc7eff', '951194c6-0b6b-45d3-9ca0-66d20777178a', 'd9425681-3c21-43d3-9e90-d9b0263ead3d', 'ea4b85c7-272a-4ac3-9488-517eab6bb513'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:48:02 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Delete snapshot completed successfully.
Sep 22 15:48:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-130b4fe5-50e4-4ecc-b67c-97e108eae500 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-76d654bd-9133-4195-8560-2ea6daa3a642-delete_snapshot" released by "delete_snapshot" :: held 3.860s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Acquiring lock "cinder-95cef4f3-6a95-45a7-be61-eaa1378c0868-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-95cef4f3-6a95-45a7-be61-eaa1378c0868-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Acquiring lock "cinder-quobyte-95cef4f3-6a95-45a7-be61-eaa1378c0868" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-quobyte-95cef4f3-6a95-45a7-be61-eaa1378c0868" acquired by "delete_volume" :: waited 0.041s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:04 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cad80a-ab09-4985-9e26-1dbea950a5e7]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:48:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:04 devstack sudo[98216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868
Sep 22 15:48:04 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:05 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868" returned: 0 in 1.213s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:05 devstack sudo[98231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868
Sep 22 15:48:05 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:05 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-95cef4f3-6a95-45a7-be61-eaa1378c0868" returned: 0 in 0.574s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-quobyte-95cef4f3-6a95-45a7-be61-eaa1378c0868" released by "delete_volume" :: held 2.047s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Created reservations ['d3a7dcb9-658f-43c0-8d23-3031e94e247f', 'a608ab95-9ed0-4d5d-a4c6-f3b0acb28fb5', 'f8f4b889-596f-4212-b4c0-b8fd111b0df1', '790f136f-591a-4b8d-82fd-3bbc15c40a8e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:06 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:48:06 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:06 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.500s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:48:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Deleted volume successfully.
Sep 22 15:48:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-394e1979-47eb-47c0-bd3d-a9a2c518ae80 tempest-SnapshotMetadataTestJSON-1530789544 None] Lock "cinder-95cef4f3-6a95-45a7-be61-eaa1378c0868-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391" returned: 0 in 11.297s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb, size 1024.00 MB, duration 11.30 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:48:11 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Converted 1024.00 MB image at 90.62 MB/s
Sep 22 15:48:11 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391 is being set with open permissions: ugo+rw
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:11 devstack sudo[98307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391
Sep 22 15:48:11 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:11 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391" returned: 0 in 0.307s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-8032461d-a96a-496c-9522-853d5abf8391" released by "_copy_volume_from_snapshot" :: held 13.016s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-e57b5f8c-f1cd-4676-a81a-46ad1fbd560a-8032461d-a96a-496c-9522-853d5abf8391" released by "_create_volume_from_snapshot" :: held 13.105s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.176s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d44f29-fae9-43bb-afda-b1dc03b6e90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8032461d-a96a-496c-9522-853d5abf8391', 'volume_size': 1, 'snapshot_id': 'e57b5f8c-f1cd-4676-a81a-46ad1fbd560a'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d140cc23-27db-4a58-b4fc-be57503282b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:11 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Volume volume-8032461d-a96a-496c-9522-853d5abf8391 (8032461d-a96a-496c-9522-853d5abf8391): created successfully
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d140cc23-27db-4a58-b4fc-be57503282b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Flow 'volume_create_manager' (1b261618-a51b-4ce6-a457-6c60a764cd60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:11 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-cc58b61d-6d93-4d53-9b4f-8740013f9a43 tempest-TestStampPattern-819849900 None] Created volume successfully.
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=90,cinder:INSERT=26,cinder:UPDATE=103,cinder:DELETE=9 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=83,cinder:UPDATE=104,cinder:INSERT=26,cinder:DELETE=9 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Flow 'volume_create_manager' (302fe2ea-5bfa-4c9d-b904-c040694bbc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8466dc80-08df-44f1-94c2-3a8cf30d8ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8466dc80-08df-44f1-94c2-3a8cf30d8ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-73629157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df481e0-f13d-446b-a843-03529c0d4bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee64400279a042aba52a3a4471184996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:21Z,use_quota=True,user_id='396d095dfc544987b2bb886b921cebac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2030ce9-a605-41c3-8152-5962f209f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2030ce9-a605-41c3-8152-5962f209f049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcf6a85-7db0-4401-851f-a054bf33556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcf6a85-7db0-4401-851f-a054bf33556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df481e0-f13d-446b-a843-03529c0d4bbf', 'volume_name': 'volume-1df481e0-f13d-446b-a843-03529c0d4bbf', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a9428a-b128-4d88-8b8f-26c55a509ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a9428a-b128-4d88-8b8f-26c55a509ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc31ebc-a170-4dc4-8fc6-4a79d002ae4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:20 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Volume 1df481e0-f13d-446b-a843-03529c0d4bbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df481e0-f13d-446b-a843-03529c0d4bbf', 'volume_size': 1}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-73629157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df481e0-f13d-446b-a843-03529c0d4bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee64400279a042aba52a3a4471184996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:21Z,use_quota=True,user_id='396d095dfc544987b2bb886b921cebac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Creating volume 1df481e0-f13d-446b-a843-03529c0d4bbf {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:48:20 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:48:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:20 devstack sudo[98423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf 1073741824
Sep 22 15:48:20 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:21 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf 1073741824" returned: 0 in 1.029s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:22 devstack sudo[98435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf
Sep 22 15:48:22 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:22 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf" returned: 0 in 0.503s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:48:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc31ebc-a170-4dc4-8fc6-4a79d002ae4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df481e0-f13d-446b-a843-03529c0d4bbf', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82acb74e-a555-456d-8361-aa83f2c83646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:22 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Volume volume-1df481e0-f13d-446b-a843-03529c0d4bbf (1df481e0-f13d-446b-a843-03529c0d4bbf): created successfully
Sep 22 15:48:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82acb74e-a555-456d-8361-aa83f2c83646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Flow 'volume_create_manager' (302fe2ea-5bfa-4c9d-b904-c040694bbc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:22 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-cd2dec7f-29ae-4343-888c-df0478302b72 tempest-VolumesTransfersV357Test-806840240 None] Created volume successfully.
Sep 22 15:48:24 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-662ab87a-e327-4551-ad4c-d2e68ea87c5a tempest-VolumesTransfersV357Test-1547930194 None] Transfer volume completed successfully.
Sep 22 15:48:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Acquiring lock "cinder-1df481e0-f13d-446b-a843-03529c0d4bbf-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Lock "cinder-1df481e0-f13d-446b-a843-03529c0d4bbf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Acquiring lock "cinder-quobyte-1df481e0-f13d-446b-a843-03529c0d4bbf" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Lock "cinder-quobyte-1df481e0-f13d-446b-a843-03529c0d4bbf" acquired by "delete_volume" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:25 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bce135-96db-4394-a7d3-499fff58ac68]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:48:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:26 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf
Sep 22 15:48:26 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:26 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf" returned: 0 in 0.576s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:26 devstack sudo[98466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf
Sep 22 15:48:26 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:26 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1df481e0-f13d-446b-a843-03529c0d4bbf" returned: 0 in 0.546s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Lock "cinder-quobyte-1df481e0-f13d-446b-a843-03529c0d4bbf" released by "delete_volume" :: held 1.228s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Created reservations ['4c9976cb-2b97-4b91-acb9-790a17f8ebc6', '0a3bf3e2-847d-4778-89d1-c73408463af0', '85bae640-060a-4e52-84d2-6ddc89ddfd29', '205744c6-6cad-4fb1-bd6c-9c4f6d1462fa'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:27 devstack sudo[98471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:48:27 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:27 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.353s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:48:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Deleted volume successfully.
Sep 22 15:48:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-380cd58a-73b0-4d66-9981-755d7ac108cb tempest-VolumesTransfersV357Test-753572051 None] Lock "cinder-1df481e0-f13d-446b-a843-03529c0d4bbf-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:48:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:28 devstack sudo[98475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:48:28 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Flow 'volume_create_manager' (43ecea93-2826-416d-b786-69c9f4dba2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e154fb37-5849-4af6-b512-06e234b50ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e154fb37-5849-4af6-b512-06e234b50ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-450894892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a25e26-e163-47eb-8e8b-4f0b53ec82ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee64400279a042aba52a3a4471184996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:29Z,use_quota=True,user_id='396d095dfc544987b2bb886b921cebac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60660076-87ca-4d1e-bd8c-34a865838093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60660076-87ca-4d1e-bd8c-34a865838093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d714639-bbd0-45ca-958d-d54b68a356dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d714639-bbd0-45ca-958d-d54b68a356dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a25e26-e163-47eb-8e8b-4f0b53ec82ff', 'volume_name': 'volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35b6f1b-79ec-4568-ac14-eeba6b0f616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35b6f1b-79ec-4568-ac14-eeba6b0f616c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22fbd72-804e-4070-abc9-9e3362695561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:29 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Volume f4a25e26-e163-47eb-8e8b-4f0b53ec82ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff', 'volume_size': 1}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-450894892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a25e26-e163-47eb-8e8b-4f0b53ec82ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee64400279a042aba52a3a4471184996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:29Z,use_quota=True,user_id='396d095dfc544987b2bb886b921cebac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Creating volume f4a25e26-e163-47eb-8e8b-4f0b53ec82ff {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:48:29 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:29 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.697s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:48:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:48:29 devstack sudo[98478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff 1073741824
Sep 22 15:48:29 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:30 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff 1073741824" returned: 0 in 0.811s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:30 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff
Sep 22 15:48:30 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:30 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff" returned: 0 in 0.555s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:48:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22fbd72-804e-4070-abc9-9e3362695561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2174e765-7359-4e8a-9075-7a7facb861f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:30 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Volume volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff (f4a25e26-e163-47eb-8e8b-4f0b53ec82ff): created successfully
Sep 22 15:48:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2174e765-7359-4e8a-9075-7a7facb861f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Flow 'volume_create_manager' (43ecea93-2826-416d-b786-69c9f4dba2e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:30 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-97d5db42-0a30-4f0d-9a88-5bf199aa7494 tempest-VolumesTransfersV357Test-806840240 None] Created volume successfully.
Sep 22 15:48:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Acquiring lock "cinder-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Lock "cinder-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Acquiring lock "cinder-quobyte-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Lock "cinder-quobyte-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:32 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d17bdb2-4601-45a1-8d74-d7e882a49d0f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:48:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:32 devstack sudo[98496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff
Sep 22 15:48:32 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:32 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff" returned: 0 in 0.442s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:33 devstack sudo[98501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff
Sep 22 15:48:33 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:33 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff" returned: 0 in 0.267s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Lock "cinder-quobyte-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff" released by "delete_volume" :: held 0.761s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Created reservations ['39c37fa4-6a89-4dfe-a363-d6a7ff97ed5b', '89d76eb7-c1c5-402c-91b6-3dc8e70185b2', 'bc39eca7-673a-40d3-b858-300885c0f4e9', '7e05d430-1367-4771-a5bc-674faeb702e5'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:33 devstack sudo[98504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:48:33 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:33 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:48:33 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Deleted volume successfully.
Sep 22 15:48:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-52a5e996-4790-4888-b634-f3280d3ff29b tempest-VolumesTransfersV357Test-753572051 None] Lock "cinder-f4a25e26-e163-47eb-8e8b-4f0b53ec82ff-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Acquiring lock "cinder-98914e65-8b80-4e37-af4e-1973c0f12469-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Lock "cinder-98914e65-8b80-4e37-af4e-1973c0f12469-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Acquiring lock "cinder-quobyte-98914e65-8b80-4e37-af4e-1973c0f12469" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Lock "cinder-quobyte-98914e65-8b80-4e37-af4e-1973c0f12469" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[337ffbcb-e1a1-4928-9120-6b6bb120d98d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:48:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:39 devstack sudo[98525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469
Sep 22 15:48:39 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:40 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469" returned: 0 in 0.614s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:40 devstack sudo[98539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469
Sep 22 15:48:40 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:40 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98914e65-8b80-4e37-af4e-1973c0f12469" returned: 0 in 0.429s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Lock "cinder-quobyte-98914e65-8b80-4e37-af4e-1973c0f12469" released by "delete_volume" :: held 1.107s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Created reservations ['a7f65911-0356-4881-93a8-6c5e8136d40b', 'b37d24e7-ef35-4288-9318-341d6b8e67ae', '9b02e0e8-e266-4cc0-a31f-2d6a1638eafc', 'eaa4c4e6-570b-47d3-97b4-b44a381c0d87'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:40 devstack sudo[98554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:48:40 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:40 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.285s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:40 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:48:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Deleted volume successfully.
Sep 22 15:48:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d494a672-9efb-49c8-9470-54303aad1719 tempest-VolumesNegativeTest-590331616 None] Lock "cinder-98914e65-8b80-4e37-af4e-1973c0f12469-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:42 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:48:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Flow 'volume_create_manager' (78cd6f1f-8338-48fa-bba7-4ac774f8e85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d13342-6207-4e85-a011-e017ec7b32e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d13342-6207-4e85-a011-e017ec7b32e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-297841491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573c9cbc-e06e-4af0-b2b0-b4b520d212f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98043f44fb74705bb8a590c7bbeafca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:43Z,use_quota=True,user_id='73e3284cdb444aea99d667b6369c4aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cc9748-541f-4384-947f-fe462df29b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cc9748-541f-4384-947f-fe462df29b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a44dc-e84a-4b3e-9514-41e9449123bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a44dc-e84a-4b3e-9514-41e9449123bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '573c9cbc-e06e-4af0-b2b0-b4b520d212f1', 'volume_name': 'volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1', 'volume_size': 2}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560048fe-b908-4bd7-be2c-07091ff0ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560048fe-b908-4bd7-be2c-07091ff0ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88078736-3533-4b69-a8eb-4a4f29172828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Volume 573c9cbc-e06e-4af0-b2b0-b4b520d212f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1', 'volume_size': 2}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-297841491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573c9cbc-e06e-4af0-b2b0-b4b520d212f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98043f44fb74705bb8a590c7bbeafca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:43Z,use_quota=True,user_id='73e3284cdb444aea99d667b6369c4aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Creating volume 573c9cbc-e06e-4af0-b2b0-b4b520d212f1 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:48:43 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:48:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1 2147483648 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:43 devstack sudo[98630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1 2147483648
Sep 22 15:48:43 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:44 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1 2147483648" returned: 0 in 1.353s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:44 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1
Sep 22 15:48:44 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:45 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1" returned: 0 in 0.678s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:48:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88078736-3533-4b69-a8eb-4a4f29172828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1', 'volume_size': 2}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc1bcb1-aac0-4bbe-9065-032c4de4ebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:45 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Volume volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1 (573c9cbc-e06e-4af0-b2b0-b4b520d212f1): created successfully
Sep 22 15:48:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc1bcb1-aac0-4bbe-9065-032c4de4ebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Flow 'volume_create_manager' (78cd6f1f-8338-48fa-bba7-4ac774f8e85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8573a00b-7b57-479d-a902-5c726993f63a tempest-VolumesCloneNegativeTest-163774478 None] Created volume successfully.
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Flow 'volume_create_manager' (2b308c1d-6e45-432a-96ae-279309267c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde90bbe-dbba-4d0b-986b-4a45b0fa7ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Acquiring lock "cinder-573c9cbc-e06e-4af0-b2b0-b4b520d212f1-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde90bbe-dbba-4d0b-986b-4a45b0fa7ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1594309436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0118a1eaabac4075954c6ceb077f3ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:47Z,use_quota=True,user_id='dd314307d77e49708f4fef8434717acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b2de22-e1e0-4ec5-9e2f-bb586af43e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b2de22-e1e0-4ec5-9e2f-bb586af43e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee8f01a-fa2c-40f2-b730-fc97b9a857cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee8f01a-fa2c-40f2-b730-fc97b9a857cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920', 'volume_name': 'volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de21314-ec5d-444f-8dfd-8be4d3abaf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de21314-ec5d-444f-8dfd-8be4d3abaf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f976e80-dd2b-496e-9fdc-f690e73e8711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:46 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Volume 5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920', 'volume_size': 1}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1594309436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0118a1eaabac4075954c6ceb077f3ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:47Z,use_quota=True,user_id='dd314307d77e49708f4fef8434717acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Creating volume 5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:48:46 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Lock "cinder-573c9cbc-e06e-4af0-b2b0-b4b520d212f1-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:46 devstack sudo[98659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920 1073741824
Sep 22 15:48:46 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Acquiring lock "cinder-quobyte-573c9cbc-e06e-4af0-b2b0-b4b520d212f1" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:48:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Lock "cinder-quobyte-573c9cbc-e06e-4af0-b2b0-b4b520d212f1" acquired by "delete_volume" :: waited 0.039s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:48:47 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed4d0fb-9909-4492-9b06-c0d1056107dc]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:48:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:47 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1
Sep 22 15:48:47 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:47 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920 1073741824" returned: 0 in 0.946s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:47 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1" returned: 0 in 0.810s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:47 devstack sudo[98675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1
Sep 22 15:48:47 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:47 devstack sudo[98677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920
Sep 22 15:48:47 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-aaaaa50e-78eb-4dbd-a927-c808049b4478 req-a706022b-e294-441a-870e-f06ebbf24d50 tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:48 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-573c9cbc-e06e-4af0-b2b0-b4b520d212f1" returned: 0 in 0.432s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Lock "cinder-quobyte-573c9cbc-e06e-4af0-b2b0-b4b520d212f1" released by "delete_volume" :: held 1.307s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:48 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920" returned: 0 in 0.425s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-aaaaa50e-78eb-4dbd-a927-c808049b4478 req-a706022b-e294-441a-870e-f06ebbf24d50 tempest-TestStampPattern-819849900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.071s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f976e80-dd2b-496e-9fdc-f690e73e8711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a96090-5244-4434-ad62-a79d8491bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-aaaaa50e-78eb-4dbd-a927-c808049b4478 req-a706022b-e294-441a-870e-f06ebbf24d50 tempest-TestStampPattern-819849900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:48 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Volume volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920 (5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920): created successfully
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a96090-5244-4434-ad62-a79d8491bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Flow 'volume_create_manager' (2b308c1d-6e45-432a-96ae-279309267c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-618adeb7-7a22-42c2-a2fa-00cb34b22955 tempest-TestMinimumBasicScenario-227826449 None] Created volume successfully.
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-aaaaa50e-78eb-4dbd-a927-c808049b4478 req-a706022b-e294-441a-870e-f06ebbf24d50 tempest-TestStampPattern-819849900 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-8032461d-a96a-496c-9522-853d5abf8391', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf7e9fd6-b2f6-463f-9eb0-e70ce1f5f09b', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Created reservations ['cd334389-e86a-44a3-97ad-df7937fadca7', '3c30dd9d-c038-4192-8727-04f6cc346ab0', 'd0b64d26-6555-4c73-95e5-9241921414e6', 'f16db423-5b87-4cc5-8126-c2b557445055'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:48:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-aaaaa50e-78eb-4dbd-a927-c808049b4478 req-a706022b-e294-441a-870e-f06ebbf24d50 tempest-TestStampPattern-819849900 None] attachment_update completed successfully.
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:48 devstack sudo[98687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:48:48 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:49 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.536s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:49 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:48:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Deleted volume successfully.
Sep 22 15:48:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25963563-c22e-4ce0-bfaf-bd955cf7e55c tempest-VolumesCloneNegativeTest-163774478 None] Lock "cinder-573c9cbc-e06e-4af0-b2b0-b4b520d212f1-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:48:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-abb3a1c5-2000-4191-b9b7-29bdfda05cea req-1bae2b8c-c889-4b7b-856a-da3b15ac78b9 tempest-TestMinimumBasicScenario-227826449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-abb3a1c5-2000-4191-b9b7-29bdfda05cea req-1bae2b8c-c889-4b7b-856a-da3b15ac78b9 tempest-TestMinimumBasicScenario-227826449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-abb3a1c5-2000-4191-b9b7-29bdfda05cea req-1bae2b8c-c889-4b7b-856a-da3b15ac78b9 tempest-TestMinimumBasicScenario-227826449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:50 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-abb3a1c5-2000-4191-b9b7-29bdfda05cea req-1bae2b8c-c889-4b7b-856a-da3b15ac78b9 tempest-TestMinimumBasicScenario-227826449 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4e74c16-1df5-4afd-b4c7-379b09d04212', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:48:50 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-abb3a1c5-2000-4191-b9b7-29bdfda05cea req-1bae2b8c-c889-4b7b-856a-da3b15ac78b9 tempest-TestMinimumBasicScenario-227826449 None] attachment_update completed successfully.
Sep 22 15:48:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-fd68cbd7-08f3-43c2-99dd-dc542616a34e req-2db17004-2c91-4edb-b97f-e9041f74a652 tempest-TestStampPattern-819849900 None] Terminate volume connection completed successfully.
Sep 22 15:48:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-fd68cbd7-08f3-43c2-99dd-dc542616a34e req-2db17004-2c91-4edb-b97f-e9041f74a652 tempest-TestStampPattern-819849900 None] Deleting attachment bf7e9fd6-b2f6-463f-9eb0-e70ce1f5f09b. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:48:56 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:48:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Flow 'volume_create_manager' (d1a9a348-0c92-46be-9980-353f24e9b747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:48:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79435ae6-91a3-415d-a346-be59399132ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79435ae6-91a3-415d-a346-be59399132ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-163325291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6028d14677144ea6b4cdc76092463b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:56Z,use_quota=True,user_id='be967758e73441098e2da67dc61f6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6d8595-b93e-473f-b837-bc9f12d326ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6d8595-b93e-473f-b837-bc9f12d326ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53537b02-38f4-41df-af19-6335cf088505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:56 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:48:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53537b02-38f4-41df-af19-6335cf088505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e', 'volume_name': 'volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd3367bf20>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98db2374-1f40-488d-8b07-8dd4d5067941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98db2374-1f40-488d-8b07-8dd4d5067941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:48:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306553a3-db39-4f3f-bf3f-35b1e180dad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:48:57 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Volume 161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd3367bf20>}
Sep 22 15:48:57 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Trying to clone 161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e from image a1740871-5367-428b-bac9-1a5ec1bb8377 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:48:57 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:48:57 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Image download 20.69 MB at 20.69 MB/s
Sep 22 15:48:57 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f56674-5b9c-49d1-8c89-7b4b51a56dfe]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:48:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:57 devstack sudo[99185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD
Sep 22 15:48:57 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:58 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 is fetched for user be967758e73441098e2da67dc61f6bbd. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e3a0a3-fc45-4959-8d5f-76af0e54943a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:58 devstack sudo[99190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD
Sep 22 15:48:58 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:58 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-163325291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6028d14677144ea6b4cdc76092463b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:48:56Z,use_quota=True,user_id='be967758e73441098e2da67dc61f6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Creating volume 161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:48:58 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:48:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:58 devstack sudo[99197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e 1073741824
Sep 22 15:48:58 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:59 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e 1073741824" returned: 0 in 0.605s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:59 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e
Sep 22 15:48:59 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:48:59 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Sep 22 15:48:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e" returned: 0 in 0.269s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:48:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:48:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:48:59 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Attempting download of a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:48:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba236fd-3cbb-4de0-8d97-4cf87781c289]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:48:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_w3_o61tm {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:48:59 devstack sudo[99207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_w3_o61tm
Sep 22 15:48:59 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:00 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_w3_o61tm" returned: 0 in 0.393s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_w3_o61tm {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:00 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_w3_o61tm
Sep 22 15:49:00 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:00 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_w3_o61tm" returned: 1 in 0.417s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_w3_o61tm' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:49:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21f19e0-82a4-416b-8ae6-c2b449da78c3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:00 devstack sudo[99216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD
Sep 22 15:49:00 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:01 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:01 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] a1740871-5367-428b-bac9-1a5ec1bb8377 was qcow2, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:49:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:01 devstack sudo[99222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e
Sep 22 15:49:01 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:03 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e" returned: 0 in 2.779s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:03 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_8xsk92fgdevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:49:03 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Converted 112.00 MB image at 40.25 MB/s
Sep 22 15:49:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:03 devstack sudo[99234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e 1G
Sep 22 15:49:03 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:04 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e 1G" returned: 0 in 0.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Downloaded image a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 for user be967758e73441098e2da67dc61f6bbd is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Marking volume 161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Copying metadata from image a1740871-5367-428b-bac9-1a5ec1bb8377 to 161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Creating volume glance metadata for volume 161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e backed by image a1740871-5367-428b-bac9-1a5ec1bb8377 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306553a3-db39-4f3f-bf3f-35b1e180dad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd3367bf20>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8ee392-d5a3-49f1-9df8-bb0ba1ee629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:04 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Volume volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e (161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e): created successfully
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8ee392-d5a3-49f1-9df8-bb0ba1ee629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Flow 'volume_create_manager' (d1a9a348-0c92-46be-9980-353f24e9b747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:04 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3d514e56-dea0-4928-a336-03c27fa4dca7 tempest-VolumesExtendTest-913910987 None] Created volume successfully.
Sep 22 15:49:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Acquiring lock "cinder-8032461d-a96a-496c-9522-853d5abf8391-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Lock "cinder-8032461d-a96a-496c-9522-853d5abf8391-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Acquiring lock "cinder-quobyte-8032461d-a96a-496c-9522-853d5abf8391" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-8032461d-a96a-496c-9522-853d5abf8391" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace15dd2-60c7-4a73-be82-7ef8d1a83c70]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cdae313d-3858-4e10-8de2-537aed4e91fd tempest-VolumesExtendTest-913910987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cdae313d-3858-4e10-8de2-537aed4e91fd tempest-VolumesExtendTest-913910987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:05 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391
Sep 22 15:49:05 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a7efb5-d718-45cb-a2a9-1f88cb500c5a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cdae313d-3858-4e10-8de2-537aed4e91fd tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:05 devstack sudo[99242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e
Sep 22 15:49:05 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:05 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391" returned: 0 in 0.512s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:05 devstack sudo[99247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391
Sep 22 15:49:05 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:05 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cdae313d-3858-4e10-8de2-537aed4e91fd tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e" returned: 0 in 0.500s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cdae313d-3858-4e10-8de2-537aed4e91fd tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e 2G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cdae313d-3858-4e10-8de2-537aed4e91fd tempest-VolumesExtendTest-913910987 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e 2G" returned: 0 in 0.163s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cdae313d-3858-4e10-8de2-537aed4e91fd tempest-VolumesExtendTest-913910987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.723s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-cdae313d-3858-4e10-8de2-537aed4e91fd tempest-VolumesExtendTest-913910987 None] Extend volume completed successfully.
Sep 22 15:49:06 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8032461d-a96a-496c-9522-853d5abf8391" returned: 0 in 0.388s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-8032461d-a96a-496c-9522-853d5abf8391" released by "delete_volume" :: held 0.976s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Created reservations ['c91f4315-3fe2-44cd-bf8f-52c3b13c7f29', '95b67b43-bfbe-4b26-a0b4-af8d58e6b61d', '9853ee1a-b413-4d6f-bf90-f956001fb437', '77dbc978-0c57-48bf-b6f9-80db4b7baa64'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:06 devstack sudo[99259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:49:06 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:06 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.305s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:49:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Deleted volume successfully.
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b4962862-a9d2-4e50-aaed-6d1f9cd86b2a tempest-TestStampPattern-819849900 None] Lock "cinder-8032461d-a96a-496c-9522-853d5abf8391-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Acquiring lock "cinder-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Lock "cinder-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Acquiring lock "cinder-quobyte-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Lock "cinder-quobyte-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[958d8db4-3e08-43f5-ae90-e22b7412d70c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:07 devstack sudo[99262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e
Sep 22 15:49:07 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:07 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e" returned: 0 in 0.607s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:07 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e
Sep 22 15:49:07 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Acquiring lock "cinder-e57b5f8c-f1cd-4676-a81a-46ad1fbd560a-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Lock "cinder-e57b5f8c-f1cd-4676-a81a-46ad1fbd560a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Acquiring lock "cinder-quobyte-ef8f0793-1294-4a45-9820-7b37cb7484cb" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-ef8f0793-1294-4a45-9820-7b37cb7484cb" acquired by "delete_snapshot" :: waited 0.042s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Acquiring lock "cinder-quobyte-e57b5f8c-f1cd-4676-a81a-46ad1fbd560a" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-e57b5f8c-f1cd-4676-a81a-46ad1fbd560a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Deleting offline snapshot e57b5f8c-f1cd-4676-a81a-46ad1fbd560a of volume ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] snapshot_file for this snap is: volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6063c1ea-f27b-4c30-aec6-4c1403b49cdd]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:08 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e" returned: 0 in 0.342s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Lock "cinder-quobyte-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e" released by "delete_volume" :: held 1.011s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Created reservations ['b8744208-ed53-405b-ae71-615d99d1d9a3', '7e1be551-8288-405b-bb57-dfa904bf6cae', '9e98c26f-c4dd-4988-896a-0b30e01d491d', '862235da-564d-46d9-952e-fb9db0d265e5'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:49:08 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a
Sep 22 15:49:08 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:08 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:49:08 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:08 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a" returned: 0 in 0.530s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef8f0793-1294-4a45-9820-7b37cb7484cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c62f959-5ba5-4563-a25a-17e622e41c2a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:08 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.298s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:49:08 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Deleted volume successfully.
Sep 22 15:49:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fb54dc59-fe02-4c0d-bb27-431b54998d8b tempest-VolumesExtendTest-913910987 None] Lock "cinder-161fc888-a5e0-4a38-afa9-5aa9d0dd6f4e-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:08 devstack sudo[99280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb
Sep 22 15:49:08 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:09 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb" returned: 0 in 0.839s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:09 devstack sudo[99347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a
Sep 22 15:49:09 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:09 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a" returned: 0 in 0.490s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:09 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a
Sep 22 15:49:09 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:10 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb.e57b5f8c-f1cd-4676-a81a-46ad1fbd560a" returned: 0 in 0.425s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Flow 'volume_create_manager' (01be35cf-c1d0-485b-80c3-26b1a78e61b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3543823f-568f-4112-9e63-0d62411426cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-e57b5f8c-f1cd-4676-a81a-46ad1fbd560a" released by "_delete_snapshot" :: held 2.464s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3543823f-568f-4112-9e63-0d62411426cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1118183087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40461ea0-2c63-4c9c-843f-f1495a1ce7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6028d14677144ea6b4cdc76092463b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:10Z,use_quota=True,user_id='be967758e73441098e2da67dc61f6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2bafc5-4155-4163-81af-75e9bd7425a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2bafc5-4155-4163-81af-75e9bd7425a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6031cb31-1610-40cb-a9bc-d8a7f4a930bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6031cb31-1610-40cb-a9bc-d8a7f4a930bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40461ea0-2c63-4c9c-843f-f1495a1ce7fe', 'volume_name': 'volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cfc6d6-f77d-49f8-88a2-9029dfbed1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cfc6d6-f77d-49f8-88a2-9029dfbed1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263d5052-c954-425a-b563-88e5c5498d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:10 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Volume 40461ea0-2c63-4c9c-843f-f1495a1ce7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe', 'volume_size': 1}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1118183087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40461ea0-2c63-4c9c-843f-f1495a1ce7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6028d14677144ea6b4cdc76092463b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:10Z,use_quota=True,user_id='be967758e73441098e2da67dc61f6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Creating volume 40461ea0-2c63-4c9c-843f-f1495a1ce7fe {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:10 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-ef8f0793-1294-4a45-9820-7b37cb7484cb" released by "delete_snapshot" :: held 2.557s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:10 devstack sudo[99358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe 1073741824
Sep 22 15:49:10 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Created reservations ['c2e4a6f2-e39a-4a8c-831a-f51b804144ca', '26d99621-e03d-434b-a3e7-6ccb3bf88805', '8d5f03d6-71e7-4f35-8d3d-8a606e9eb7b6', 'bfacbebe-d36d-424e-94bb-242f9ed54170'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:49:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Delete snapshot completed successfully.
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c19a39a3-f97b-4896-a328-db6ad71d0427 tempest-TestStampPattern-819849900 None] Lock "cinder-e57b5f8c-f1cd-4676-a81a-46ad1fbd560a-delete_snapshot" released by "delete_snapshot" :: held 2.771s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:10 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe 1073741824" returned: 0 in 0.570s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:11 devstack sudo[99364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe
Sep 22 15:49:11 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:11 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" returned: 0 in 0.287s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263d5052-c954-425a-b563-88e5c5498d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e30f2c-7209-4fe5-9fbe-3beb139fc9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:11 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Volume volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe (40461ea0-2c63-4c9c-843f-f1495a1ce7fe): created successfully
Sep 22 15:49:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e30f2c-7209-4fe5-9fbe-3beb139fc9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Flow 'volume_create_manager' (01be35cf-c1d0-485b-80c3-26b1a78e61b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:11 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-16d8759e-4369-4627-9d89-c88d4043cd5e tempest-VolumesExtendTest-913910987 None] Created volume successfully.
Sep 22 15:49:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Creating offline snapshot 3416545e-0b21-4bad-811e-9b0c23234aa5 of volume 40461ea0-2c63-4c9c-843f-f1495a1ce7fe {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:49:12 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdc51a6-d7f2-4def-a112-677724264c05]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:13 devstack sudo[99375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe
Sep 22 15:49:13 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:13 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" returned: 0 in 0.701s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:13 devstack sudo[99402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 1G
Sep 22 15:49:13 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:14 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 1G" returned: 0 in 0.733s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:14 devstack sudo[99419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5
Sep 22 15:49:14 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:14 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5" returned: 0 in 0.555s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:14 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 is being set with open permissions: ugo+rw
Sep 22 15:49:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:14 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5
Sep 22 15:49:14 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:15 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5" returned: 0 in 0.657s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:15 devstack sudo[99439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.info
Sep 22 15:49:15 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:16 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.info" returned: 0 in 0.620s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:16 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.info is being set with open permissions: ugo+rw
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:16 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.info
Sep 22 15:49:16 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:16 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.info" returned: 0 in 0.446s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.958s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Acquiring lock "cinder-ef8f0793-1294-4a45-9820-7b37cb7484cb-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-14cf2ceb-cb9a-4f16-ad6b-64fb25b463ee tempest-VolumesExtendTest-913910987 None] Create snapshot completed successfully
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Lock "cinder-ef8f0793-1294-4a45-9820-7b37cb7484cb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Acquiring lock "cinder-quobyte-ef8f0793-1294-4a45-9820-7b37cb7484cb" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-ef8f0793-1294-4a45-9820-7b37cb7484cb" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5261860-0a29-4f80-80a4-9903e50cb9c9]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:17 devstack sudo[99448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb
Sep 22 15:49:17 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ea2a55f6-5625-4af6-ab82-9025ec35960d tempest-VolumesExtendTest-913910987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ea2a55f6-5625-4af6-ab82-9025ec35960d tempest-VolumesExtendTest-913910987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:17 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81351a1-f2ab-4a3d-818d-a4d782baea94]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ea2a55f6-5625-4af6-ab82-9025ec35960d tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:17 devstack sudo[99453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe
Sep 22 15:49:17 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:17 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb" returned: 0 in 0.646s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:17 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb
Sep 22 15:49:17 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:18 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ea2a55f6-5625-4af6-ab82-9025ec35960d tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" returned: 0 in 0.669s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:18 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ea2a55f6-5625-4af6-ab82-9025ec35960d tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 2G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ef8f0793-1294-4a45-9820-7b37cb7484cb" returned: 0 in 0.609s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Lock "cinder-quobyte-ef8f0793-1294-4a45-9820-7b37cb7484cb" released by "delete_volume" :: held 1.388s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Created reservations ['fd72815b-ef33-4ea6-9d0d-18de1b074242', '8c2517c7-9a2a-495b-ab3c-8741cf3b53ea', 'a6316468-71cc-4f25-862c-bb0879d1a682', '104d268d-c94f-47df-a088-101ddf753796'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ea2a55f6-5625-4af6-ab82-9025ec35960d tempest-VolumesExtendTest-913910987 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 2G" returned: 0 in 0.271s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ea2a55f6-5625-4af6-ab82-9025ec35960d tempest-VolumesExtendTest-913910987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:18 devstack sudo[99465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:49:18 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ea2a55f6-5625-4af6-ab82-9025ec35960d tempest-VolumesExtendTest-913910987 None] Extend volume completed successfully.
Sep 22 15:49:18 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.449s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:18 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:49:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Deleted volume successfully.
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8c1471b4-da18-4281-9323-0f6122923413 tempest-TestStampPattern-819849900 None] Lock "cinder-ef8f0793-1294-4a45-9820-7b37cb7484cb-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Acquiring lock "cinder-3416545e-0b21-4bad-811e-9b0c23234aa5-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Lock "cinder-3416545e-0b21-4bad-811e-9b0c23234aa5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Acquiring lock "cinder-quobyte-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Lock "cinder-quobyte-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Acquiring lock "cinder-quobyte-3416545e-0b21-4bad-811e-9b0c23234aa5" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Lock "cinder-quobyte-3416545e-0b21-4bad-811e-9b0c23234aa5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Deleting offline snapshot 3416545e-0b21-4bad-811e-9b0c23234aa5 of volume 40461ea0-2c63-4c9c-843f-f1495a1ce7fe {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] snapshot_file for this snap is: volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2305bc2d-b63b-4362-8ab4-90693e60300a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:20 devstack sudo[99468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5
Sep 22 15:49:20 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:20 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5" returned: 0 in 0.516s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:49:20 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e6a8f6-655f-459f-b8b8-8fbe1955b4a0]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:20 devstack sudo[99474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe
Sep 22 15:49:20 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:21 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" returned: 0 in 0.471s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:21 devstack sudo[99480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5
Sep 22 15:49:21 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:21 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5" returned: 0 in 0.571s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:21 devstack sudo[99486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5
Sep 22 15:49:21 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:21 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe.3416545e-0b21-4bad-811e-9b0c23234aa5" returned: 0 in 0.325s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:21 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=84,cinder:INSERT=30,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:49:21 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=80,cinder:SELECT=79,cinder:INSERT=22,cinder:DELETE=7 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:49:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Lock "cinder-quobyte-3416545e-0b21-4bad-811e-9b0c23234aa5" released by "_delete_snapshot" :: held 2.115s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Lock "cinder-quobyte-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" released by "delete_snapshot" :: held 2.158s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:22 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Created reservations ['e698c941-b7df-4637-924d-08e91fbe1adb', 'dc119659-d659-4358-86f6-bf09d621e169', '5cdc2fe9-ca04-4d8c-96b7-137a82649b2a', '4436f752-1be2-4daa-a4dc-b08fcaa052da'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:49:22 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Delete snapshot completed successfully.
Sep 22 15:49:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4a1ba7c5-518b-49e3-b178-563050d3ef64 tempest-VolumesExtendTest-913910987 None] Lock "cinder-3416545e-0b21-4bad-811e-9b0c23234aa5-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Acquiring lock "cinder-40461ea0-2c63-4c9c-843f-f1495a1ce7fe-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Lock "cinder-40461ea0-2c63-4c9c-843f-f1495a1ce7fe-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Acquiring lock "cinder-quobyte-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Lock "cinder-quobyte-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[86efedc0-7670-4ea7-8599-32029e95c481]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Flow 'volume_create_manager' (172005e0-c5ed-44b4-bd61-ea6ea820f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34da7ae-aea9-48d8-88e1-fa489462ac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34da7ae-aea9-48d8-88e1-fa489462ac99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-947482950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411fae03-b627-4fd6-b1fb-4cfda6837a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05982a8c50a44e58ffa75e55b0353ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:23Z,use_quota=True,user_id='f852e28d932d48d3bacb28407b47615b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d44cea1-4a0d-465e-901c-b3fa77b344ff),volume_type_id=7d44cea1-4a0d-465e-901c-b3fa77b344ff)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:23 devstack sudo[99495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540ae354-06f6-43a2-889d-51b7c7ba2b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:23 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540ae354-06f6-43a2-889d-51b7c7ba2b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7be05b-73de-4253-a18b-25649d8f7b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7be05b-73de-4253-a18b-25649d8f7b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411fae03-b627-4fd6-b1fb-4cfda6837a25', 'volume_name': 'volume-411fae03-b627-4fd6-b1fb-4cfda6837a25', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c1f836-fc65-48ba-a481-92520180a699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c1f836-fc65-48ba-a481-92520180a699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58fc08f-459e-42d3-9945-06788e47874a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:23 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Volume 411fae03-b627-4fd6-b1fb-4cfda6837a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411fae03-b627-4fd6-b1fb-4cfda6837a25', 'volume_size': 1}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-947482950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411fae03-b627-4fd6-b1fb-4cfda6837a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05982a8c50a44e58ffa75e55b0353ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:23Z,use_quota=True,user_id='f852e28d932d48d3bacb28407b47615b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d44cea1-4a0d-465e-901c-b3fa77b344ff),volume_type_id=7d44cea1-4a0d-465e-901c-b3fa77b344ff)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Creating volume 411fae03-b627-4fd6-b1fb-4cfda6837a25 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:23 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:23 devstack sudo[99497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25 1073741824
Sep 22 15:49:23 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:24 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" returned: 0 in 0.718s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:24 devstack sudo[99506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe
Sep 22 15:49:24 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Flow 'volume_create_manager' (027e171a-2ff9-4fa7-90ef-41f810fc20b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7bed75-ab31-4880-bd12-536ad2fd3486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7bed75-ab31-4880-bd12-536ad2fd3486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1545672301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc2a959-70fe-423c-bf9a-0ae8039df205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05982a8c50a44e58ffa75e55b0353ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:24Z,use_quota=True,user_id='f852e28d932d48d3bacb28407b47615b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(427b7429-d613-4b61-81cc-3cdef339f40b),volume_type_id=427b7429-d613-4b61-81cc-3cdef339f40b)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c2fb5c-f58c-41c3-a2d8-f0bf9d4aa1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c2fb5c-f58c-41c3-a2d8-f0bf9d4aa1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aff048e-10db-4c4d-96b0-a67ae4acc447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aff048e-10db-4c4d-96b0-a67ae4acc447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acc2a959-70fe-423c-bf9a-0ae8039df205', 'volume_name': 'volume-acc2a959-70fe-423c-bf9a-0ae8039df205', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483126a1-7141-48f8-ac25-951743db1c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483126a1-7141-48f8-ac25-951743db1c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:24 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cd0457-c0b6-4cbf-a715-9feb41b69017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:24 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Volume acc2a959-70fe-423c-bf9a-0ae8039df205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acc2a959-70fe-423c-bf9a-0ae8039df205', 'volume_size': 1}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25 1073741824" returned: 0 in 0.942s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:24 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" returned: 0 in 0.518s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Lock "cinder-quobyte-40461ea0-2c63-4c9c-843f-f1495a1ce7fe" released by "delete_volume" :: held 1.329s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:24 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25
Sep 22 15:49:24 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Created reservations ['3b4db986-b3ed-4b8e-b372-933eaf387374', '124bef1a-2d66-432e-b00f-d1548f0effce', 'a0e8546c-84ad-4ca0-9cb0-2169572bcc5c', '400ae6b4-405d-4c2f-bd32-262fea7e2ea6'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:24 devstack sudo[99512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:49:24 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:25 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.346s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:49:25 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Deleted volume successfully.
Sep 22 15:49:25 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25" returned: 0 in 0.575s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e5acb478-91ca-4c15-9c09-18617c9155d7 tempest-VolumesExtendTest-913910987 None] Lock "cinder-40461ea0-2c63-4c9c-843f-f1495a1ce7fe-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.720s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1545672301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc2a959-70fe-423c-bf9a-0ae8039df205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05982a8c50a44e58ffa75e55b0353ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:24Z,use_quota=True,user_id='f852e28d932d48d3bacb28407b47615b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(427b7429-d613-4b61-81cc-3cdef339f40b),volume_type_id=427b7429-d613-4b61-81cc-3cdef339f40b)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Creating volume acc2a959-70fe-423c-bf9a-0ae8039df205 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:25 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58fc08f-459e-42d3-9945-06788e47874a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411fae03-b627-4fd6-b1fb-4cfda6837a25', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff1339f-5ad1-4452-b01d-8c0c57b5fd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:25 devstack sudo[99516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205 1073741824
Sep 22 15:49:25 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Volume volume-411fae03-b627-4fd6-b1fb-4cfda6837a25 (411fae03-b627-4fd6-b1fb-4cfda6837a25): created successfully
Sep 22 15:49:25 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff1339f-5ad1-4452-b01d-8c0c57b5fd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Flow 'volume_create_manager' (172005e0-c5ed-44b4-bd61-ea6ea820f897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:25 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d96a2fb7-1b08-4247-85d4-db9cc3fe34f1 tempest-TestInstancesWithCinderVolumes-788792293 None] Created volume successfully.
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Flow 'volume_create_manager' (e0484f1a-a905-4459-aa8c-c8a9da7cfec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caae473b-5adc-4fb9-86c0-67d7dab6748d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caae473b-5adc-4fb9-86c0-67d7dab6748d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1793227403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9e93de-240c-42dd-bf0e-2c9d39fd1b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05982a8c50a44e58ffa75e55b0353ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:26Z,use_quota=True,user_id='f852e28d932d48d3bacb28407b47615b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1579a3bd-25c6-40a1-9644-ed4c203a9e27),volume_type_id=1579a3bd-25c6-40a1-9644-ed4c203a9e27)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3e0090-6a76-42e8-8f1c-d96bdcf9c259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3e0090-6a76-42e8-8f1c-d96bdcf9c259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14f9dae-3b2e-4fad-b05e-3974284ab932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:25 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:49:26 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205 1073741824" returned: 0 in 0.861s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:26 devstack sudo[99524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205
Sep 22 15:49:26 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:26 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205" returned: 0 in 0.382s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cd0457-c0b6-4cbf-a715-9feb41b69017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc2a959-70fe-423c-bf9a-0ae8039df205', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27cb2fc-6019-45eb-97db-5a0516c32fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:26 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Volume volume-acc2a959-70fe-423c-bf9a-0ae8039df205 (acc2a959-70fe-423c-bf9a-0ae8039df205): created successfully
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27cb2fc-6019-45eb-97db-5a0516c32fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Flow 'volume_create_manager' (027e171a-2ff9-4fa7-90ef-41f810fc20b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:26 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-88592271-589e-4cdc-b8d3-5a94fdc128d8 tempest-TestInstancesWithCinderVolumes-788792293 None] Created volume successfully.
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14f9dae-3b2e-4fad-b05e-3974284ab932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c9e93de-240c-42dd-bf0e-2c9d39fd1b32', 'volume_name': 'volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32', 'volume_size': 1, 'image_id': '3019311b-da0a-41ae-851d-632f6ac0b448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3019311b-da0a-41ae-851d-632f6ac0b448', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1803879929', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a05982a8c50a44e58ffa75e55b0353ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3019311b-da0a-41ae-851d-632f6ac0b448', 'created_at': datetime.datetime(2026, 9, 22, 13, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3019311b-da0a-41ae-851d-632f6ac0b448/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd2948a060>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73630225-c988-490a-a758-0f9d0124f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73630225-c988-490a-a758-0f9d0124f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31335fa-9a90-4d4a-a458-41611d48b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:26 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Volume 6c9e93de-240c-42dd-bf0e-2c9d39fd1b32: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32', 'volume_size': 1, 'image_id': '3019311b-da0a-41ae-851d-632f6ac0b448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3019311b-da0a-41ae-851d-632f6ac0b448', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1803879929', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a05982a8c50a44e58ffa75e55b0353ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3019311b-da0a-41ae-851d-632f6ac0b448', 'created_at': datetime.datetime(2026, 9, 22, 13, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3019311b-da0a-41ae-851d-632f6ac0b448/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd2948a060>}
Sep 22 15:49:26 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Trying to clone 6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 from image 3019311b-da0a-41ae-851d-632f6ac0b448 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3019311b-da0a-41ae-851d-632f6ac0b448', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:49:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:49:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:28 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:49:28 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:29 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:49:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:49:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:49:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD, size 20.69 MB, duration 4.14 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:49:31 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Image download 20.69 MB at 5.00 MB/s
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd4502d-5720-4a37-831f-ced9863b5bdb]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (99b4d74a-545c-4629-a951-41063e9a4e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5225ece-035b-4880-bce8-418cd0bcc285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:31 devstack sudo[99532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD
Sep 22 15:49:31 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5225ece-035b-4880-bce8-418cd0bcc285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-457630786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a13b7d-6fc9-4d45-978d-10680a93d4c9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:31Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4fe1c3-f1d2-4b52-bc95-fd0139f3131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4fe1c3-f1d2-4b52-bc95-fd0139f3131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b648f1-30c1-4c5e-9f2c-ddc85e756ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b648f1-30c1-4c5e-9f2c-ddc85e756ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a13b7d-6fc9-4d45-978d-10680a93d4c9', 'volume_name': 'volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113bea60-7403-4c2d-a6aa-4bb294a860f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113bea60-7403-4c2d-a6aa-4bb294a860f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371338b6-5d15-4867-8cd4-7038c9f2f593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:31 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Volume 84a13b7d-6fc9-4d45-978d-10680a93d4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9', 'volume_size': 1}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-457630786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a13b7d-6fc9-4d45-978d-10680a93d4c9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:31Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Creating volume 84a13b7d-6fc9-4d45-978d-10680a93d4c9 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:31 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:31 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9 1073741824
Sep 22 15:49:31 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:31 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD" returned: 0 in 0.335s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Temporary image 3019311b-da0a-41ae-851d-632f6ac0b448 is fetched for user f852e28d932d48d3bacb28407b47615b. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa108335-a393-452d-aa9a-5f9031938227]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:31 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD
Sep 22 15:49:31 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:31 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9 1073741824" returned: 0 in 0.459s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:31 devstack sudo[99544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9
Sep 22 15:49:31 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:31 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:32 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9" returned: 0 in 0.339s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.220s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1793227403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9e93de-240c-42dd-bf0e-2c9d39fd1b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05982a8c50a44e58ffa75e55b0353ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:26Z,use_quota=True,user_id='f852e28d932d48d3bacb28407b47615b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1579a3bd-25c6-40a1-9644-ed4c203a9e27),volume_type_id=1579a3bd-25c6-40a1-9644-ed4c203a9e27)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Creating volume 6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:32 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371338b6-5d15-4867-8cd4-7038c9f2f593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:32 devstack sudo[99551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 1073741824
Sep 22 15:49:32 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1239a17b-cf81-4ac8-8304-7c1935d24760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:32 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Volume volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9 (84a13b7d-6fc9-4d45-978d-10680a93d4c9): created successfully
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1239a17b-cf81-4ac8-8304-7c1935d24760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (99b4d74a-545c-4629-a951-41063e9a4e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-45fe4117-6a46-4bd9-8b35-01ab69248ff1 tempest-VolumesGetTest-1760875235 None] Created volume successfully.
Sep 22 15:49:32 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 1073741824" returned: 0 in 0.475s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:32 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32
Sep 22 15:49:32 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:33 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32" returned: 0 in 0.290s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Attempting download of 3019311b-da0a-41ae-851d-632f6ac0b448 ((None, [{'url': 'file:///opt/stack/data/glance/images/3019311b-da0a-41ae-851d-632f6ac0b448', 'metadata': {}}])) to volume 6c9e93de-240c-42dd-bf0e-2c9d39fd1b32. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb6ee58-b9a7-4359-9414-aa0506dccb40]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3019311b-da0a-41ae-851d-632f6ac0b448_rk61av2d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:33 devstack sudo[99562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3019311b-da0a-41ae-851d-632f6ac0b448_rk61av2d
Sep 22 15:49:33 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:33 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3019311b-da0a-41ae-851d-632f6ac0b448_rk61av2d" returned: 0 in 0.331s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3019311b-da0a-41ae-851d-632f6ac0b448_rk61av2d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:33 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3019311b-da0a-41ae-851d-632f6ac0b448_rk61av2d
Sep 22 15:49:33 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:33 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3019311b-da0a-41ae-851d-632f6ac0b448_rk61av2d" returned: 1 in 0.375s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3019311b-da0a-41ae-851d-632f6ac0b448_rk61av2d' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2baeca-799c-42c5-acaa-55bf1e189543]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:33 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD
Sep 22 15:49:33 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:34 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] 3019311b-da0a-41ae-851d-632f6ac0b448 was qcow2, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:34 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32
Sep 22 15:49:34 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (4d9b5b09-2a10-46ec-a25f-439bf2110392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58416b4-d271-4b28-bd33-b55ab95140df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58416b4-d271-4b28-bd33-b55ab95140df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-715836107',display_name='tempest-VolumesGetTest-Volume-2003604319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e566050a-f168-47b3-a927-4b7472be0e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:34Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed17800a-7bf5-41ad-8cce-88fe9850ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed17800a-7bf5-41ad-8cce-88fe9850ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db3fe39-8f02-4135-b779-864e54af8c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db3fe39-8f02-4135-b779-864e54af8c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e566050a-f168-47b3-a927-4b7472be0e6d', 'volume_name': 'volume-e566050a-f168-47b3-a927-4b7472be0e6d', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3054a5e7-43e8-4a64-8335-64f1773aac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3054a5e7-43e8-4a64-8335-64f1773aac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba574c91-02fc-483e-b460-8ebf35d16f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:34 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Volume e566050a-f168-47b3-a927-4b7472be0e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e566050a-f168-47b3-a927-4b7472be0e6d', 'volume_size': 1}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-715836107',display_name='tempest-VolumesGetTest-Volume-2003604319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e566050a-f168-47b3-a927-4b7472be0e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:34Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Creating volume e566050a-f168-47b3-a927-4b7472be0e6d {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:34 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:34 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d 1073741824
Sep 22 15:49:34 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:35 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d 1073741824" returned: 0 in 0.569s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:35 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d
Sep 22 15:49:35 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:35 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:35 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba574c91-02fc-483e-b460-8ebf35d16f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e566050a-f168-47b3-a927-4b7472be0e6d', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28655bb2-9d79-465c-98ac-61c6e17f8ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:35 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Volume volume-e566050a-f168-47b3-a927-4b7472be0e6d (e566050a-f168-47b3-a927-4b7472be0e6d): created successfully
Sep 22 15:49:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28655bb2-9d79-465c-98ac-61c6e17f8ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (4d9b5b09-2a10-46ec-a25f-439bf2110392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ad96d7b5-6047-4d8d-a482-8752b7100095 tempest-VolumesGetTest-1760875235 None] Created volume successfully.
Sep 22 15:49:36 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32" returned: 0 in 2.176s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3019311b-da0a-41ae-851d-632f6ac0b448_dwsnjxa2devstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:49:36 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Converted 112.00 MB image at 51.45 MB/s
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:36 devstack sudo[99594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 1G
Sep 22 15:49:36 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-e566050a-f168-47b3-a927-4b7472be0e6d-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Lock "cinder-e566050a-f168-47b3-a927-4b7472be0e6d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-quobyte-e566050a-f168-47b3-a927-4b7472be0e6d" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-e566050a-f168-47b3-a927-4b7472be0e6d" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[de017c4e-80e3-4dcd-bb53-a668b64bed18]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (e6396f6f-d17a-4cbd-9b1b-b27dda8b0bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:36 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae55fa4-0733-45c0-9950-62458d8a463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 1G" returned: 0 in 0.541s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Downloaded image 3019311b-da0a-41ae-851d-632f6ac0b448 ((None, [{'url': 'file:///opt/stack/data/glance/images/3019311b-da0a-41ae-851d-632f6ac0b448', 'metadata': {}}])) to volume 6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Temporary image 3019311b-da0a-41ae-851d-632f6ac0b448 for user f852e28d932d48d3bacb28407b47615b is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Marking volume 6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae55fa4-0733-45c0-9950-62458d8a463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1879872825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9236c3-9938-484d-810b-4d770d55c9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:37Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bb132a-7e85-456d-a7f1-f1f19ca66bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bb132a-7e85-456d-a7f1-f1f19ca66bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d7a435-80a6-4763-89cf-5645aec6a13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:36 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d
Sep 22 15:49:36 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d7a435-80a6-4763-89cf-5645aec6a13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9236c3-9938-484d-810b-4d770d55c9b8', 'volume_name': 'volume-ea9236c3-9938-484d-810b-4d770d55c9b8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a82bd3-4103-4b01-95cc-11df7f196706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a82bd3-4103-4b01-95cc-11df7f196706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b296ad-0e54-401e-afc2-1c0758f9c3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume ea9236c3-9938-484d-810b-4d770d55c9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9236c3-9938-484d-810b-4d770d55c9b8', 'volume_size': 1}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1879872825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9236c3-9938-484d-810b-4d770d55c9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:37Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Creating volume ea9236c3-9938-484d-810b-4d770d55c9b8 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:37 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Copying metadata from image 3019311b-da0a-41ae-851d-632f6ac0b448 to 6c9e93de-240c-42dd-bf0e-2c9d39fd1b32. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Creating volume glance metadata for volume 6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 backed by image 3019311b-da0a-41ae-851d-632f6ac0b448 with: {'image_id': '3019311b-da0a-41ae-851d-632f6ac0b448', 'image_name': 'tempest-scenario-img--1803879929', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:49:37 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8 1073741824
Sep 22 15:49:37 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31335fa-9a90-4d4a-a458-41611d48b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32', 'volume_size': 1, 'image_id': '3019311b-da0a-41ae-851d-632f6ac0b448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3019311b-da0a-41ae-851d-632f6ac0b448', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1803879929', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a05982a8c50a44e58ffa75e55b0353ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3019311b-da0a-41ae-851d-632f6ac0b448', 'created_at': datetime.datetime(2026, 9, 22, 13, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3019311b-da0a-41ae-851d-632f6ac0b448/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd2948a060>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fda8120-1956-4527-9c34-23d158d65a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:37 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Volume volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 (6c9e93de-240c-42dd-bf0e-2c9d39fd1b32): created successfully
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fda8120-1956-4527-9c34-23d158d65a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Flow 'volume_create_manager' (e0484f1a-a905-4459-aa8c-c8a9da7cfec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:37 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b98971df-9e4b-42ca-8c06-697fae9ddda5 tempest-TestInstancesWithCinderVolumes-788792293 None] Created volume successfully.
Sep 22 15:49:37 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d" returned: 0 in 0.489s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:37 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d
Sep 22 15:49:37 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:37 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e566050a-f168-47b3-a927-4b7472be0e6d" returned: 0 in 0.321s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:37 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8 1073741824" returned: 0 in 0.653s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-e566050a-f168-47b3-a927-4b7472be0e6d" released by "delete_volume" :: held 0.871s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:37 devstack sudo[99615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8
Sep 22 15:49:37 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Created reservations ['68406d40-dfb5-40c4-91c7-1ae1615b09a1', '3aa32747-ef1d-4987-a5c5-1558429a10cf', '176b67fc-2b4c-43b9-b1a8-c90f64648640', 'c05839ce-380b-486a-9c84-5d6d6aae0291'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:38 devstack sudo[99617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:49:38 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:38 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-84a13b7d-6fc9-4d45-978d-10680a93d4c9-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8" returned: 0 in 0.460s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b296ad-0e54-401e-afc2-1c0758f9c3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9236c3-9938-484d-810b-4d770d55c9b8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bafbc6-36d3-4382-a95f-794b7875a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Lock "cinder-84a13b7d-6fc9-4d45-978d-10680a93d4c9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume volume-ea9236c3-9938-484d-810b-4d770d55c9b8 (ea9236c3-9938-484d-810b-4d770d55c9b8): created successfully
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bafbc6-36d3-4382-a95f-794b7875a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (e6396f6f-d17a-4cbd-9b1b-b27dda8b0bda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d1902fc8-c378-45d2-9a35-891ad9641234 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created volume successfully.
Sep 22 15:49:38 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-quobyte-84a13b7d-6fc9-4d45-978d-10680a93d4c9" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.292s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:49:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Deleted volume successfully.
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-84a13b7d-6fc9-4d45-978d-10680a93d4c9" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7a308493-4e5b-4da7-aa59-5d8ebdbae8c0 tempest-VolumesGetTest-1760875235 None] Lock "cinder-e566050a-f168-47b3-a927-4b7472be0e6d-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aa448e-2d43-4ab0-aa74-495686921e95]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:38 devstack sudo[99621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9
Sep 22 15:49:38 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:38 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9" returned: 0 in 0.425s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:38 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9
Sep 22 15:49:38 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:39 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-84a13b7d-6fc9-4d45-978d-10680a93d4c9" returned: 0 in 0.286s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-84a13b7d-6fc9-4d45-978d-10680a93d4c9" released by "delete_volume" :: held 0.775s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Created reservations ['fa2df433-e645-482f-bf75-0975a5d89209', 'b5b3e0f8-e3b3-4ebb-a7a4-127a08a7d67e', '335142ad-04e6-4b01-88f3-ce3abb530e00', '38d940f4-2887-47d6-b6fe-faf33b2bf041'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Creating offline snapshot 21270241-1771-401e-bd11-0a5dbaecf1cf of volume ea9236c3-9938-484d-810b-4d770d55c9b8 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd12b94-0f28-4346-81f2-3553e5c29736]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:39 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:49:39 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:39 devstack sudo[99636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8
Sep 22 15:49:39 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:39 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.485s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:49:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Deleted volume successfully.
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a3ebd83e-7814-47e6-9236-f640dc357fba tempest-VolumesGetTest-1760875235 None] Lock "cinder-84a13b7d-6fc9-4d45-978d-10680a93d4c9-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:39 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8" returned: 0 in 0.607s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:39 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf 1G
Sep 22 15:49:39 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (1deb7f72-73be-4884-a76d-d74acd2d623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a61550-0bbf-43f6-8e62-4314b90ea01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a61550-0bbf-43f6-8e62-4314b90ea01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-76942948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966bdc2a-7f99-46a3-a150-43e36587f8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:40Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ad2997-64ce-4d04-8f71-812f5b85f162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ad2997-64ce-4d04-8f71-812f5b85f162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1983bcd3-4cf3-4d1b-aa27-8957d177271a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1983bcd3-4cf3-4d1b-aa27-8957d177271a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966bdc2a-7f99-46a3-a150-43e36587f8ad', 'volume_name': 'volume-966bdc2a-7f99-46a3-a150-43e36587f8ad', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc50a0c3-f3b8-46d5-af98-ce2a0bdb5b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc50a0c3-f3b8-46d5-af98-ce2a0bdb5b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3265e2-d2dc-42aa-a948-27a0582bc143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:40 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Volume 966bdc2a-7f99-46a3-a150-43e36587f8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966bdc2a-7f99-46a3-a150-43e36587f8ad', 'volume_size': 1}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:40 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf 1G" returned: 0 in 0.674s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9236c3-9938-484d-810b-4d770d55c9b8 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:40 devstack sudo[99651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9236c3-9938-484d-810b-4d770d55c9b8 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf
Sep 22 15:49:40 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-44b2dd35-6a0a-4fcb-b833-19a920bdec5c req-f1b7d30b-4441-47bc-90ef-fddd0497658a tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:41 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9236c3-9938-484d-810b-4d770d55c9b8 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf" returned: 0 in 0.465s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:41 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf is being set with open permissions: ugo+rw
Sep 22 15:49:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:41 devstack sudo[99666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf
Sep 22 15:49:41 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:41 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf" returned: 0 in 0.329s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:41 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.info
Sep 22 15:49:41 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:41 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.info" returned: 0 in 0.307s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:41 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.info is being set with open permissions: ugo+rw
Sep 22 15:49:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:41 devstack sudo[99672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.info
Sep 22 15:49:41 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:42 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.info" returned: 0 in 0.285s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.826s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.826s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-76942948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966bdc2a-7f99-46a3-a150-43e36587f8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:40Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Creating volume 966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:42 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:42 devstack sudo[99677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad 1073741824
Sep 22 15:49:42 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-97da7084-abef-4cc7-bd8c-80551e154f14 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Create snapshot completed successfully
Sep 22 15:49:42 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad 1073741824" returned: 0 in 0.746s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:43 devstack sudo[99686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad
Sep 22 15:49:43 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-3cb58eb3-51a0-4a0e-a7f1-68da6bec4fc5 req-43941f6b-47a6-4074-87fb-62a1b11d5785 tempest-TestMinimumBasicScenario-227826449 None] Terminate volume connection completed successfully.
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-3cb58eb3-51a0-4a0e-a7f1-68da6bec4fc5 req-43941f6b-47a6-4074-87fb-62a1b11d5785 tempest-TestMinimumBasicScenario-227826449 None] Deleting attachment f4e74c16-1df5-4afd-b4c7-379b09d04212. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:49:43 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad" returned: 0 in 0.399s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-44b2dd35-6a0a-4fcb-b833-19a920bdec5c req-f1b7d30b-4441-47bc-90ef-fddd0497658a tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.407s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-44b2dd35-6a0a-4fcb-b833-19a920bdec5c req-f1b7d30b-4441-47bc-90ef-fddd0497658a tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3265e2-d2dc-42aa-a948-27a0582bc143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966bdc2a-7f99-46a3-a150-43e36587f8ad', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b5ace1-0c6e-4061-9215-cc737fac57c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Volume volume-966bdc2a-7f99-46a3-a150-43e36587f8ad (966bdc2a-7f99-46a3-a150-43e36587f8ad): created successfully
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b5ace1-0c6e-4061-9215-cc737fac57c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (1deb7f72-73be-4884-a76d-d74acd2d623c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-44b2dd35-6a0a-4fcb-b833-19a920bdec5c req-f1b7d30b-4441-47bc-90ef-fddd0497658a tempest-TestInstancesWithCinderVolumes-788792293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd28fb706-ecd4-4b55-8e4d-5116f00a2a2b', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:49:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-585f6ed1-04b9-43e4-8ca2-829eedf29abc tempest-VolumesGetTest-1760875235 None] Created volume successfully.
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (c076e955-4570-40dd-a576-517eaaa93014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ae4c0c-f4e8-413a-a5fa-5036958ab6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ae4c0c-f4e8-413a-a5fa-5036958ab6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50021768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810a8d6a-de64-4b5a-a137-172655ac0388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:43Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed3f833-ffe8-4e8d-bc01-2fedf9b293bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed3f833-ffe8-4e8d-bc01-2fedf9b293bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fb3fc0-88a1-4b2e-b074-17ff9cfddd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fb3fc0-88a1-4b2e-b074-17ff9cfddd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '810a8d6a-de64-4b5a-a137-172655ac0388', 'volume_name': 'volume-810a8d6a-de64-4b5a-a137-172655ac0388', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87201ac0-4408-414e-aa7c-16b36a0a65fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87201ac0-4408-414e-aa7c-16b36a0a65fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae58f9a-b847-466b-9712-c7231eac3981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume 810a8d6a-de64-4b5a-a137-172655ac0388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-810a8d6a-de64-4b5a-a137-172655ac0388', 'volume_size': 1}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50021768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810a8d6a-de64-4b5a-a137-172655ac0388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:43Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Creating volume 810a8d6a-de64-4b5a-a137-172655ac0388 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:43 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:43 devstack sudo[99690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388 1073741824
Sep 22 15:49:43 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-44b2dd35-6a0a-4fcb-b833-19a920bdec5c req-f1b7d30b-4441-47bc-90ef-fddd0497658a tempest-TestInstancesWithCinderVolumes-788792293 None] attachment_update completed successfully.
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Acquiring lock "cinder-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Lock "cinder-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Acquiring lock "cinder-quobyte-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Lock "cinder-quobyte-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920" acquired by "delete_volume" :: waited 0.065s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:44 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388 1073741824" returned: 0 in 0.710s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f57d7-c9a4-4b38-9761-90393356fac4]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (2123bff0-94a4-4062-acde-84fa49cf0104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655504d2-f755-44fd-a020-5298fe1bc779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:44 devstack sudo[99696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920
Sep 22 15:49:44 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655504d2-f755-44fd-a020-5298fe1bc779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-961670009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ace880a-db85-4d02-84ca-abf06cf5e97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:44Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2795f62-4690-4713-8499-2247b955c64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2795f62-4690-4713-8499-2247b955c64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8867071-e3df-4983-a81b-8b43f19ac8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8867071-e3df-4983-a81b-8b43f19ac8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ace880a-db85-4d02-84ca-abf06cf5e97f', 'volume_name': 'volume-9ace880a-db85-4d02-84ca-abf06cf5e97f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8466f157-9a98-4224-aa81-aa3a3dec9c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8466f157-9a98-4224-aa81-aa3a3dec9c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d1380e-8375-492f-bff7-47c58037214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:44 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume 9ace880a-db85-4d02-84ca-abf06cf5e97f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ace880a-db85-4d02-84ca-abf06cf5e97f', 'volume_size': 1}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:44 devstack sudo[99775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388
Sep 22 15:49:44 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:45 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920" returned: 0 in 0.959s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:45 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388" returned: 0 in 0.626s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-961670009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ace880a-db85-4d02-84ca-abf06cf5e97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:44Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Creating volume 9ace880a-db85-4d02-84ca-abf06cf5e97f {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:49:45 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:45 devstack sudo[99812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:45 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae58f9a-b847-466b-9712-c7231eac3981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810a8d6a-de64-4b5a-a137-172655ac0388', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bf03c3-e3d3-4cb6-afea-39f1e22fb67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:45 devstack sudo[99817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f 1073741824
Sep 22 15:49:45 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (86b04e70-50ed-4d0b-bcec-787af6fae51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f510e0-47be-4477-a86a-a79c8d485df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f510e0-47be-4477-a86a-a79c8d485df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-425097981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038a3d75-6450-4fab-93b9-c573f81e1f88,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=966bdc2a-7f99-46a3-a150-43e36587f8ad,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:45Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9ba580-9fab-4e3c-bc74-8dd78aee365b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9ba580-9fab-4e3c-bc74-8dd78aee365b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9255bb-f948-4fe5-a98a-3f73dba94d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:45 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume volume-810a8d6a-de64-4b5a-a137-172655ac0388 (810a8d6a-de64-4b5a-a137-172655ac0388): created successfully
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bf03c3-e3d3-4cb6-afea-39f1e22fb67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (c076e955-4570-40dd-a576-517eaaa93014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9255bb-f948-4fe5-a98a-3f73dba94d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '038a3d75-6450-4fab-93b9-c573f81e1f88', 'volume_name': 'volume-038a3d75-6450-4fab-93b9-c573f81e1f88', 'volume_size': 1, 'source_volid': '966bdc2a-7f99-46a3-a150-43e36587f8ad', 'source_volstatus': 'available'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01b617f-2976-47cd-90f6-d82a908c01c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01b617f-2976-47cd-90f6-d82a908c01c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46127620-ee6d-4e96-9772-d35cfcadf232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:46 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Volume 038a3d75-6450-4fab-93b9-c573f81e1f88: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-038a3d75-6450-4fab-93b9-c573f81e1f88', 'volume_size': 1, 'source_volid': '966bdc2a-7f99-46a3-a150-43e36587f8ad', 'source_volstatus': 'available'}
Sep 22 15:49:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-97467048-2ab1-4cc7-ba78-e23b89d7fbab tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created volume successfully.
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (5a85c135-ac81-4ed9-b978-0e150ceb2b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217a88ee-b438-49f5-bf01-9c21d8348ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:46 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920" returned: 0 in 0.805s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Lock "cinder-quobyte-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920" released by "delete_volume" :: held 1.873s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217a88ee-b438-49f5-bf01-9c21d8348ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879814759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99196b21-2400-45f0-983f-43d760585de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:46Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c2ea68-0dd5-4a20-a3f1-586ca4db9cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c2ea68-0dd5-4a20-a3f1-586ca4db9cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87fd8ba-31c2-43c3-99e7-f7a2285c2a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87fd8ba-31c2-43c3-99e7-f7a2285c2a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99196b21-2400-45f0-983f-43d760585de6', 'volume_name': 'volume-99196b21-2400-45f0-983f-43d760585de6', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8e603e-5ca2-4410-892a-d04c61357848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8e603e-5ca2-4410-892a-d04c61357848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11156dbe-0854-4e3c-8797-901ff8f6e024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:46 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume 99196b21-2400-45f0-983f-43d760585de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99196b21-2400-45f0-983f-43d760585de6', 'volume_size': 1}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Created reservations ['df778267-4896-494b-ab52-b5b771be8a32', 'cdc814b6-eb6c-4a9c-92d5-ff70045d48e3', '7e94acb7-4ea8-45c1-bf4a-2d3a3589085b', '183e85a0-4df1-4aa2-8ee7-a431112eba0c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:49:46 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f 1073741824" returned: 0 in 1.268s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (40105502-8b02-4642-a4fd-d6f659fa4121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c662e79-acdb-4f62-b36b-d065b825191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:47 devstack sudo[100192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:49:47 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c662e79-acdb-4f62-b36b-d065b825191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813840311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1d1fa7-c994-4173-85f1-c63975dce951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:47Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f
Sep 22 15:49:47 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1353a3-25cb-4568-9098-3bcb9405fd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1353a3-25cb-4568-9098-3bcb9405fd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4f9296-0b4c-4f0b-9ecb-0c858b4e481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4f9296-0b4c-4f0b-9ecb-0c858b4e481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1d1fa7-c994-4173-85f1-c63975dce951', 'volume_name': 'volume-ab1d1fa7-c994-4173-85f1-c63975dce951', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95817b42-2ce1-497b-a2df-005152da4739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95817b42-2ce1-497b-a2df-005152da4739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119deed0-020c-45a0-bad6-695ef06a78d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume ab1d1fa7-c994-4173-85f1-c63975dce951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1d1fa7-c994-4173-85f1-c63975dce951', 'volume_size': 1}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:47 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.455s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:49:47 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Deleted volume successfully.
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-714cea1d-365c-4191-b746-96504e7b7afa tempest-TestMinimumBasicScenario-227826449 None] Lock "cinder-5d5a0297-5e2c-44f7-bbe3-5b7fd51cf920-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:49:47 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f" returned: 0 in 0.556s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.565s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:47 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Cloning volume 966bdc2a-7f99-46a3-a150-43e36587f8ad to volume 038a3d75-6450-4fab-93b9-c573f81e1f88
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d1380e-8375-492f-bff7-47c58037214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ace880a-db85-4d02-84ca-abf06cf5e97f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a927e3-0227-404d-9eb2-5dd95790b615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume volume-9ace880a-db85-4d02-84ca-abf06cf5e97f (9ace880a-db85-4d02-84ca-abf06cf5e97f): created successfully
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a927e3-0227-404d-9eb2-5dd95790b615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (2123bff0-94a4-4062-acde-84fa49cf0104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Creating offline snapshot e948683e-b151-44dd-af57-86660ab3564e of volume 966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (219af469-03d6-419f-958a-7e8db6f6a70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b6f373-9687-4de2-ae42-9f0b22e2da5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd34cff-3c3d-430b-858e-fe867971228a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:47 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-513164dd-d477-43dd-959e-b5a4cd5063a1 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created volume successfully.
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b6f373-9687-4de2-ae42-9f0b22e2da5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369337982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00210bfc-1dce-4a49-b025-9e314d2bcb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:48Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78056b8c-dec1-478d-9b8f-cee522c95fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78056b8c-dec1-478d-9b8f-cee522c95fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f22a18-2de5-4768-9d8d-ef207e77a426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f22a18-2de5-4768-9d8d-ef207e77a426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00210bfc-1dce-4a49-b025-9e314d2bcb36', 'volume_name': 'volume-00210bfc-1dce-4a49-b025-9e314d2bcb36', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e05dce4-80aa-4c06-8918-3721710ce913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e05dce4-80aa-4c06-8918-3721710ce913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bd5409-7c08-4c37-a74a-3f2c23335c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:49:47 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume 00210bfc-1dce-4a49-b025-9e314d2bcb36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00210bfc-1dce-4a49-b025-9e314d2bcb36', 'volume_size': 1}
Sep 22 15:49:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:48 devstack sudo[100201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad
Sep 22 15:49:48 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:48 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad" returned: 0 in 0.988s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:48 devstack sudo[100227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e 1G
Sep 22 15:49:48 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:49 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e 1G" returned: 0 in 0.615s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966bdc2a-7f99-46a3-a150-43e36587f8ad -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:49 devstack sudo[100233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966bdc2a-7f99-46a3-a150-43e36587f8ad -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e
Sep 22 15:49:49 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:49 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966bdc2a-7f99-46a3-a150-43e36587f8ad -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e" returned: 0 in 0.343s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:49 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e is being set with open permissions: ugo+rw
Sep 22 15:49:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:49 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e
Sep 22 15:49:49 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:50 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e" returned: 0 in 0.339s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:50 devstack sudo[100244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.info
Sep 22 15:49:50 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:50 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.info" returned: 0 in 0.500s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:50 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.info is being set with open permissions: ugo+rw
Sep 22 15:49:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:50 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.info
Sep 22 15:49:50 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:51 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.info" returned: 0 in 0.433s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-quobyte-038a3d75-6450-4fab-93b9-c573f81e1f88" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-038a3d75-6450-4fab-93b9-c573f81e1f88" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] snapshot: e948683e-b151-44dd-af57-86660ab3564e, volume: 038a3d75-6450-4fab-93b9-c573f81e1f88,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1640e6ba-c8c1-495a-b8cb-29d67b968602]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:51 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e
Sep 22 15:49:51 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:51 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e" returned: 0 in 0.490s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966bdc2a-7f99-46a3-a150-43e36587f8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bbeb5e-4741-447e-913b-442a230e27e1]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:49:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:51 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad
Sep 22 15:49:51 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:49:52 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Sep 22 15:49:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad" returned: 0 in 0.480s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:49:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:49:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:49:52 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88 not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:49:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:49:52 devstack sudo[100261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88
Sep 22 15:49:52 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:00 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=57,cinder:INSERT=14,cinder:UPDATE=67,cinder:DELETE=9 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:50:00 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=76,cinder:INSERT=27,cinder:UPDATE=77,cinder:DELETE=5 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:50:03 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88" returned: 0 in 10.698s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad, size 1024.00 MB, duration 10.70 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:50:03 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Converted 1024.00 MB image at 95.71 MB/s
Sep 22 15:50:03 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88 is being set with open permissions: ugo+rw
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:03 devstack sudo[100280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88
Sep 22 15:50:03 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:03 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88" returned: 0 in 0.397s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-038a3d75-6450-4fab-93b9-c573f81e1f88" released by "_copy_volume_from_snapshot" :: held 12.171s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-quobyte-e948683e-b151-44dd-af57-86660ab3564e" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-e948683e-b151-44dd-af57-86660ab3564e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Deleting offline snapshot e948683e-b151-44dd-af57-86660ab3564e of volume 966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] snapshot_file for this snap is: volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[076e2290-1a35-4f34-a1b0-4c5136494052]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:03 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e
Sep 22 15:50:03 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:04 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e" returned: 0 in 0.519s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966bdc2a-7f99-46a3-a150-43e36587f8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:50:04 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ce90c1-a8a8-43be-bea2-2f7f462e051c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:04 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad
Sep 22 15:50:04 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:04 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad" returned: 0 in 0.781s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:04 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e
Sep 22 15:50:04 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:05 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e" returned: 0 in 0.431s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:05 devstack sudo[100333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e
Sep 22 15:50:05 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:05 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad.e948683e-b151-44dd-af57-86660ab3564e" returned: 0 in 0.280s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-e948683e-b151-44dd-af57-86660ab3564e" released by "_delete_snapshot" :: held 2.179s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.076s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.276s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879814759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99196b21-2400-45f0-983f-43d760585de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:46Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Creating volume 99196b21-2400-45f0-983f-43d760585de6 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:05 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:05 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6 1073741824
Sep 22 15:50:05 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46127620-ee6d-4e96-9772-d35cfcadf232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038a3d75-6450-4fab-93b9-c573f81e1f88', 'volume_size': 1, 'source_volid': '966bdc2a-7f99-46a3-a150-43e36587f8ad', 'source_volstatus': 'available'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c52c76c-fa28-415b-9ec4-9cbb591e9272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:05 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Volume volume-038a3d75-6450-4fab-93b9-c573f81e1f88 (038a3d75-6450-4fab-93b9-c573f81e1f88): created successfully
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c52c76c-fa28-415b-9ec4-9cbb591e9272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (86b04e70-50ed-4d0b-bcec-787af6fae51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:05 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-faa00f18-b26e-4f3f-a1b9-b509410963de tempest-VolumesGetTest-1760875235 None] Created volume successfully.
Sep 22 15:50:06 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6 1073741824" returned: 0 in 0.643s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:06 devstack sudo[100350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6
Sep 22 15:50:06 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:06 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6" returned: 0 in 0.336s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.529s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813840311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1d1fa7-c994-4173-85f1-c63975dce951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:47Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Creating volume ab1d1fa7-c994-4173-85f1-c63975dce951 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:06 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:06 devstack sudo[100353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951 1073741824
Sep 22 15:50:06 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11156dbe-0854-4e3c-8797-901ff8f6e024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99196b21-2400-45f0-983f-43d760585de6', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d47e28d-ac43-47f3-913f-191e37a2b4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:06 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume volume-99196b21-2400-45f0-983f-43d760585de6 (99196b21-2400-45f0-983f-43d760585de6): created successfully
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d47e28d-ac43-47f3-913f-191e37a2b4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:06 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (5a85c135-ac81-4ed9-b978-0e150ceb2b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-66e36f02-a20d-4fcd-8f5d-de36e3790fe6 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created volume successfully.
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (d1606b92-2103-4279-a331-2f6515142317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6bc5f9-e494-4886-8398-25669a681cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6bc5f9-e494-4886-8398-25669a681cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-589776819',display_name='tempest-VolumesGetTest-Volume-1287784391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daa9cda-17a5-4b88-b972-c1cb10bf1b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:07Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d711cdc1-16cb-4192-b023-fbb10d8e2686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d711cdc1-16cb-4192-b023-fbb10d8e2686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445ff1c0-0b11-48f6-8045-06b46eb13e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445ff1c0-0b11-48f6-8045-06b46eb13e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7daa9cda-17a5-4b88-b972-c1cb10bf1b6a', 'volume_name': 'volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae1be19-cec1-4f2f-9c19-d99763cde09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae1be19-cec1-4f2f-9c19-d99763cde09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aefec89-86f4-46e9-a2ad-e35cde39a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:07 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Volume 7daa9cda-17a5-4b88-b972-c1cb10bf1b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a', 'volume_size': 1}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:07 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951 1073741824" returned: 0 in 0.526s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:07 devstack sudo[100359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951
Sep 22 15:50:07 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:07 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951" returned: 0 in 0.249s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.603s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369337982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00210bfc-1dce-4a49-b025-9e314d2bcb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d05a80fe54775a02b364bbb7abb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:49:48Z,use_quota=True,user_id='23a176cc94bf4fea94f90cb919e8aa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Creating volume 00210bfc-1dce-4a49-b025-9e314d2bcb36 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:07 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119deed0-020c-45a0-bad6-695ef06a78d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1d1fa7-c994-4173-85f1-c63975dce951', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:07 devstack sudo[100362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36 1073741824
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fe1917-f10d-4f8b-90f8-060963b9a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:07 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:07 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume volume-ab1d1fa7-c994-4173-85f1-c63975dce951 (ab1d1fa7-c994-4173-85f1-c63975dce951): created successfully
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fe1917-f10d-4f8b-90f8-060963b9a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:07 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (40105502-8b02-4642-a4fd-d6f659fa4121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:07 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d4d1f778-1636-4a6f-a44e-ee341d8dec39 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created volume successfully.
Sep 22 15:50:08 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36 1073741824" returned: 0 in 0.551s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:08 devstack sudo[100368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36
Sep 22 15:50:08 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:08 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36" returned: 0 in 0.255s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-589776819',display_name='tempest-VolumesGetTest-Volume-1287784391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daa9cda-17a5-4b88-b972-c1cb10bf1b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:07Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Creating volume 7daa9cda-17a5-4b88-b972-c1cb10bf1b6a {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:08 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bd5409-7c08-4c37-a74a-3f2c23335c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00210bfc-1dce-4a49-b025-9e314d2bcb36', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594dcda6-b641-4760-b151-119a968572d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:08 devstack sudo[100371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a 1073741824
Sep 22 15:50:08 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:08 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Volume volume-00210bfc-1dce-4a49-b025-9e314d2bcb36 (00210bfc-1dce-4a49-b025-9e314d2bcb36): created successfully
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594dcda6-b641-4760-b151-119a968572d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Flow 'volume_create_manager' (219af469-03d6-419f-958a-7e8db6f6a70b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:08 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-68594d9d-5d2f-4887-aa0e-71a4d2fac728 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created volume successfully.
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-00210bfc-1dce-4a49-b025-9e314d2bcb36-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-00210bfc-1dce-4a49-b025-9e314d2bcb36-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-quobyte-00210bfc-1dce-4a49-b025-9e314d2bcb36" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-00210bfc-1dce-4a49-b025-9e314d2bcb36" acquired by "delete_volume" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdea74bf-80c9-4f3a-a306-7397e1927332]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:09 devstack sudo[100377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36
Sep 22 15:50:09 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:09 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a 1073741824" returned: 0 in 0.608s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:09 devstack sudo[100380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a
Sep 22 15:50:09 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:09 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36" returned: 0 in 0.404s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:09 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36
Sep 22 15:50:09 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:09 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a" returned: 0 in 0.334s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aefec89-86f4-46e9-a2ad-e35cde39a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543c48cc-db7b-4be9-bacc-54844221ba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:09 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Volume volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a (7daa9cda-17a5-4b88-b972-c1cb10bf1b6a): created successfully
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543c48cc-db7b-4be9-bacc-54844221ba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (d1606b92-2103-4279-a331-2f6515142317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:09 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-69a62a37-59b4-4f32-a91f-53a5f95f8e81 tempest-VolumesGetTest-1760875235 None] Created volume successfully.
Sep 22 15:50:09 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-00210bfc-1dce-4a49-b025-9e314d2bcb36" returned: 0 in 0.303s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-00210bfc-1dce-4a49-b025-9e314d2bcb36" released by "delete_volume" :: held 0.754s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created reservations ['61e978e7-e0f6-4269-8fb3-249552ac7f7b', '692af2af-da63-4fc5-8b2f-cf17287260bb', '9382c5cd-c9d7-4dfa-bedf-9abe04be91d0', '07cae3ba-3056-491e-a8b6-6a16551a54ab'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:09 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:09 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-ab1d1fa7-c994-4173-85f1-c63975dce951-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-ab1d1fa7-c994-4173-85f1-c63975dce951-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-quobyte-ab1d1fa7-c994-4173-85f1-c63975dce951" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-ab1d1fa7-c994-4173-85f1-c63975dce951" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:10 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.304s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Deleted volume successfully.
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b789d459-09b5-4319-8c5e-b1c37e7d0a83]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-109681e1-4975-4090-9950-5bc527f6f681 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-00210bfc-1dce-4a49-b025-9e314d2bcb36-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:10 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951
Sep 22 15:50:10 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Lock "cinder-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-quobyte-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:10 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951" returned: 0 in 0.454s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a" acquired by "delete_volume" :: waited 0.044s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:10 devstack sudo[100434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951
Sep 22 15:50:10 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a331931-0952-4bc4-b9bf-7a86e218bafc]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:10 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a
Sep 22 15:50:10 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:10 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1d1fa7-c994-4173-85f1-c63975dce951" returned: 0 in 0.292s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-ab1d1fa7-c994-4173-85f1-c63975dce951" released by "delete_volume" :: held 0.802s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:10 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created reservations ['6f82abe4-660d-46a3-9ce7-443a5f7a0fe7', '056ab5de-06e3-4eb5-b64b-c7b7b0ecb5ae', '95fad85e-c6d8-420a-8579-718a5bd3ecd2', '8ab5c2f0-02ec-4689-a8ff-ec86819ad9d6'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:11 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:11 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:11 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a" returned: 0 in 0.420s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:11 devstack sudo[100445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a
Sep 22 15:50:11 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-99196b21-2400-45f0-983f-43d760585de6-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-99196b21-2400-45f0-983f-43d760585de6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-quobyte-99196b21-2400-45f0-983f-43d760585de6" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-99196b21-2400-45f0-983f-43d760585de6" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:11 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.285s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:11 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Deleted volume successfully.
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d2f855-0817-4570-9129-59846cc969c7]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-25d41b7c-910b-414e-866c-3d957e9cc050 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-ab1d1fa7-c994-4173-85f1-c63975dce951-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:11 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a" returned: 0 in 0.355s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a" released by "delete_volume" :: held 0.835s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:11 devstack sudo[100448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6
Sep 22 15:50:11 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Created reservations ['05f55e1e-bd62-47b3-9704-6315b636b139', '3f55130c-9597-426a-b956-809a4ea46335', 'bf3a1075-2af3-41fa-b0fc-9aa9b22ce461', '3cc08070-b78f-4c87-8e89-0af1213fae2b'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:11 devstack sudo[100451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:11 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:11 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-038a3d75-6450-4fab-93b9-c573f81e1f88-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6" returned: 0 in 0.468s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Lock "cinder-038a3d75-6450-4fab-93b9-c573f81e1f88-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:11 devstack sudo[100456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6
Sep 22 15:50:11 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-quobyte-038a3d75-6450-4fab-93b9-c573f81e1f88" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-038a3d75-6450-4fab-93b9-c573f81e1f88" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f3906a-3ccc-4b10-ba66-81abb5d9a8ee]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:11 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.334s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:11 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:11 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Deleted volume successfully.
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-82b0cdaa-70a5-44a0-992b-0a96b62b4c6c tempest-VolumesGetTest-1760875235 None] Lock "cinder-7daa9cda-17a5-4b88-b972-c1cb10bf1b6a-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:12 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88
Sep 22 15:50:12 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:12 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-99196b21-2400-45f0-983f-43d760585de6" returned: 0 in 0.331s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-99196b21-2400-45f0-983f-43d760585de6" released by "delete_volume" :: held 0.867s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created reservations ['af62e1b5-1c8f-4a09-b127-a59fb5496f1a', 'a069a9fa-0082-48e2-b138-a324dcf1db93', '79481cff-ea13-4f8f-a2bb-f5cec5a95c98', 'f0112dc1-3e56-4cf4-902b-beb08990170c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:12 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:12 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:12 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88" returned: 0 in 0.470s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-9ace880a-db85-4d02-84ca-abf06cf5e97f-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:12 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88
Sep 22 15:50:12 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-9ace880a-db85-4d02-84ca-abf06cf5e97f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-quobyte-9ace880a-db85-4d02-84ca-abf06cf5e97f" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-9ace880a-db85-4d02-84ca-abf06cf5e97f" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7b5183-3780-49d9-bddf-5664f2be44a5]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:12 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.317s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:12 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Deleted volume successfully.
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0310b7e9-cde8-46f9-9203-57e572b38f2f tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-99196b21-2400-45f0-983f-43d760585de6-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:12 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f
Sep 22 15:50:12 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:12 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-038a3d75-6450-4fab-93b9-c573f81e1f88" returned: 0 in 0.321s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-038a3d75-6450-4fab-93b9-c573f81e1f88" released by "delete_volume" :: held 0.861s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Created reservations ['51f26ace-34ce-4b5c-ba7b-6fc23638697f', 'a2a055ea-4f55-4f8a-87f0-d8089053e3fe', '121c85d8-e4ed-44bd-9d58-6bc2408e1c6b', 'ecc72d08-ce8e-4dfc-a722-c60b9c4e963e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:12 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:12 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:13 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f" returned: 0 in 0.469s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-966bdc2a-7f99-46a3-a150-43e36587f8ad-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:13 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f
Sep 22 15:50:13 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Lock "cinder-966bdc2a-7f99-46a3-a150-43e36587f8ad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-quobyte-966bdc2a-7f99-46a3-a150-43e36587f8ad" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-966bdc2a-7f99-46a3-a150-43e36587f8ad" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[47784de3-b767-48fb-a809-559fe35c3950]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:13 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.361s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Deleted volume successfully.
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b1a967e0-881f-4523-a6c4-c6e336279cd3 tempest-VolumesGetTest-1760875235 None] Lock "cinder-038a3d75-6450-4fab-93b9-c573f81e1f88-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:13 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ace880a-db85-4d02-84ca-abf06cf5e97f" returned: 0 in 0.328s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:13 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad
Sep 22 15:50:13 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-9ace880a-db85-4d02-84ca-abf06cf5e97f" released by "delete_volume" :: held 0.850s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created reservations ['6ca0b5bc-e682-4d75-9df0-1533d2c32003', '234645b2-ed28-4a75-8646-8d82892f6a8e', '77f75601-827e-4463-a881-0afaf62d980f', 'a257a189-bf99-440c-8bba-c46d84f6cda5'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:13 devstack sudo[100486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:13 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-810a8d6a-de64-4b5a-a137-172655ac0388-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-810a8d6a-de64-4b5a-a137-172655ac0388-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-quobyte-810a8d6a-de64-4b5a-a137-172655ac0388" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-810a8d6a-de64-4b5a-a137-172655ac0388" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:13 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad" returned: 0 in 0.660s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fadaa3-334d-4a79-95fe-64da6e409a9c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:13 devstack sudo[100492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad
Sep 22 15:50:13 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:13 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.337s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:13 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Deleted volume successfully.
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-098a66a4-3592-4806-92a6-032ab71ac6cb tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-9ace880a-db85-4d02-84ca-abf06cf5e97f-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:14 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388
Sep 22 15:50:14 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:14 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-966bdc2a-7f99-46a3-a150-43e36587f8ad" returned: 0 in 0.425s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-966bdc2a-7f99-46a3-a150-43e36587f8ad" released by "delete_volume" :: held 1.172s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Created reservations ['1b0018d0-cf57-4360-bf17-0aaca42a35b8', '89863b2b-2179-40c9-8072-f5c8a7fc28f8', '2b0d252b-5103-4946-b094-1cf17fd63cd1', '29a785a5-dbb7-4d89-aa1f-165e22e10edf'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:14 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388" returned: 0 in 0.502s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:14 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388
Sep 22 15:50:14 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:14 devstack sudo[100502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:14 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:14 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-810a8d6a-de64-4b5a-a137-172655ac0388" returned: 0 in 0.308s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-810a8d6a-de64-4b5a-a137-172655ac0388" released by "delete_volume" :: held 0.884s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created reservations ['3729d137-649d-4a82-a0ab-06ecd3353afd', 'c8ff6a1e-9c89-4172-9fc5-0abcb53d025f', '0bc7968d-6407-4784-a6ff-14d4de1a5032', 'fbbbe145-2bcb-40b2-a72c-e3939e421e77'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:14 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.304s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Deleted volume successfully.
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-670c5718-ed4f-4b73-b6b2-80d17494eb8a tempest-VolumesGetTest-1760875235 None] Lock "cinder-966bdc2a-7f99-46a3-a150-43e36587f8ad-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:14 devstack sudo[100506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:14 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:15 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.283s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:15 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Deleted volume successfully.
Sep 22 15:50:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c48cd318-7e56-4a15-829b-0aceaf769571 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-810a8d6a-de64-4b5a-a137-172655ac0388-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-21270241-1771-401e-bd11-0a5dbaecf1cf-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-21270241-1771-401e-bd11-0a5dbaecf1cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-quobyte-ea9236c3-9938-484d-810b-4d770d55c9b8" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-ea9236c3-9938-484d-810b-4d770d55c9b8" acquired by "delete_snapshot" :: waited 0.052s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-quobyte-21270241-1771-401e-bd11-0a5dbaecf1cf" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-21270241-1771-401e-bd11-0a5dbaecf1cf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Deleting offline snapshot 21270241-1771-401e-bd11-0a5dbaecf1cf of volume ea9236c3-9938-484d-810b-4d770d55c9b8 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] snapshot_file for this snap is: volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[566435fa-b9a0-4fd2-a03f-ceb617cb2354]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (d398a5c4-6adc-4cbf-bdf6-69ddf493846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3b8a1c-e399-4958-a7a7-671c265f8782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3b8a1c-e399-4958-a7a7-671c265f8782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-137043709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13aa44d2-7dae-4644-bede-99f8520f829c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:16Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d2e232-7c20-43a4-8a0e-0b3d8cf6f7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d2e232-7c20-43a4-8a0e-0b3d8cf6f7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604bdde3-02f8-4e35-b153-c1b0464e5c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:16 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:50:16 devstack sudo[100524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf
Sep 22 15:50:16 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:17 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf" returned: 0 in 0.801s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9236c3-9938-484d-810b-4d770d55c9b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c85280-e0b8-45df-ab86-ab8c686a532a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:17 devstack sudo[100534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8
Sep 22 15:50:17 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604bdde3-02f8-4e35-b153-c1b0464e5c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13aa44d2-7dae-4644-bede-99f8520f829c', 'volume_name': 'volume-13aa44d2-7dae-4644-bede-99f8520f829c', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd29477980>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f475c3-9392-452f-8b07-e4c022ab07c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f475c3-9392-452f-8b07-e4c022ab07c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0ac710-0985-4dc5-b8e5-82dfc1bac9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:17 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Volume 13aa44d2-7dae-4644-bede-99f8520f829c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13aa44d2-7dae-4644-bede-99f8520f829c', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd29477980>}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Trying to clone 13aa44d2-7dae-4644-bede-99f8520f829c from image a1740871-5367-428b-bac9-1a5ec1bb8377 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-54d78e47-2a35-402d-b3ad-91b668f84120 req-8e4d8bbf-4739-44c0-b459-a688bfa70dcb tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-54d78e47-2a35-402d-b3ad-91b668f84120 req-8e4d8bbf-4739-44c0-b459-a688bfa70dcb tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-54d78e47-2a35-402d-b3ad-91b668f84120 req-8e4d8bbf-4739-44c0-b459-a688bfa70dcb tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-54d78e47-2a35-402d-b3ad-91b668f84120 req-8e4d8bbf-4739-44c0-b459-a688bfa70dcb tempest-TestInstancesWithCinderVolumes-788792293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-411fae03-b627-4fd6-b1fb-4cfda6837a25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd752ba7-9576-4249-8224-ee4f00dbb227', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:50:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-54d78e47-2a35-402d-b3ad-91b668f84120 req-8e4d8bbf-4739-44c0-b459-a688bfa70dcb tempest-TestInstancesWithCinderVolumes-788792293 None] attachment_update completed successfully.
Sep 22 15:50:17 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8" returned: 0 in 0.506s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:17 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf
Sep 22 15:50:17 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:17 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:50:17 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Image download 20.69 MB at 20.69 MB/s
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[76566811-ec12-4386-8f34-d408ea00274f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:18 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD
Sep 22 15:50:18 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:18 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf" returned: 0 in 0.568s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:18 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf
Sep 22 15:50:18 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:18 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 is fetched for user a467037bec184d88b9bacab8491b1855. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:50:18 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8.21270241-1771-401e-bd11-0a5dbaecf1cf" returned: 0 in 0.354s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-21270241-1771-401e-bd11-0a5dbaecf1cf" released by "_delete_snapshot" :: held 2.513s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-ea9236c3-9938-484d-810b-4d770d55c9b8" released by "delete_snapshot" :: held 2.561s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[290600fc-5cc2-406f-a9f0-5c9596ae8475]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created reservations ['c5e42ea6-36e5-4d2d-a092-c9d81da045d7', 'b668ad33-560c-49eb-ae1a-3abc9cb0c13b', '903ee7b2-ab32-4656-adba-26b285bc2a6b', 'f148aef3-6c82-49fd-9154-5420bf8ef2c1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Delete snapshot completed successfully.
Sep 22 15:50:18 devstack sudo[100560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD
Sep 22 15:50:18 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f261d24b-09a9-40ff-a416-453c2f1c7603 tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-21270241-1771-401e-bd11-0a5dbaecf1cf-delete_snapshot" released by "delete_snapshot" :: held 2.768s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:19 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-137043709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13aa44d2-7dae-4644-bede-99f8520f829c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:16Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Creating volume 13aa44d2-7dae-4644-bede-99f8520f829c {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:19 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:19 devstack sudo[100565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c 1073741824
Sep 22 15:50:19 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-ea9236c3-9938-484d-810b-4d770d55c9b8-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-ea9236c3-9938-484d-810b-4d770d55c9b8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "cinder-quobyte-ea9236c3-9938-484d-810b-4d770d55c9b8" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-ea9236c3-9938-484d-810b-4d770d55c9b8" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77321dc-236e-404f-92ca-bdc549b64fd5]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:19 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c 1073741824" returned: 0 in 0.635s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:19 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8
Sep 22 15:50:19 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:19 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c
Sep 22 15:50:19 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:20 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c" returned: 0 in 0.343s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Attempting download of a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 13aa44d2-7dae-4644-bede-99f8520f829c. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:50:20 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8" returned: 0 in 0.632s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:20 devstack sudo[100588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8
Sep 22 15:50:20 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66136b8-9a5c-491e-801e-454034151918]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377__5t9di91 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:20 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377__5t9di91
Sep 22 15:50:20 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:20 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ea9236c3-9938-484d-810b-4d770d55c9b8" returned: 0 in 0.345s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-quobyte-ea9236c3-9938-484d-810b-4d770d55c9b8" released by "delete_volume" :: held 1.094s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Created reservations ['19777041-ea34-4576-be1f-3575dea4eefc', '777c6c45-f072-4dff-82c2-57f80827b846', '4e27bd66-563f-4c9a-baa3-0353cfe861fb', 'e7e258c9-068e-4a95-b20a-5b9137d6f4d1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:20 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377__5t9di91" returned: 0 in 0.545s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377__5t9di91 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:20 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:20 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:21 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377__5t9di91
Sep 22 15:50:21 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:21 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.340s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Deleted volume successfully.
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-f17723b4-3ddc-4494-a128-cb3c5a6f61c6 req-ce490481-3be4-4e7c-afd1-8cb23a273cb2 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-f17723b4-3ddc-4494-a128-cb3c5a6f61c6 req-ce490481-3be4-4e7c-afd1-8cb23a273cb2 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-5b5016e9-5a12-484d-b46c-d480893def5e tempest-CreateVolumesFromSnapshotTest-1447253808 None] Lock "cinder-ea9236c3-9938-484d-810b-4d770d55c9b8-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-f17723b4-3ddc-4494-a128-cb3c5a6f61c6 req-ce490481-3be4-4e7c-afd1-8cb23a273cb2 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:21 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377__5t9di91" returned: 1 in 0.531s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377__5t9di91' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d32a8c-5b6d-4a36-8f05-78950d14fa4e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-f17723b4-3ddc-4494-a128-cb3c5a6f61c6 req-ce490481-3be4-4e7c-afd1-8cb23a273cb2 tempest-TestInstancesWithCinderVolumes-788792293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-acc2a959-70fe-423c-bf9a-0ae8039df205', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb61ee15-67e4-4c1d-baa4-2bb501e664b2', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:50:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-f17723b4-3ddc-4494-a128-cb3c5a6f61c6 req-ce490481-3be4-4e7c-afd1-8cb23a273cb2 tempest-TestInstancesWithCinderVolumes-788792293 None] attachment_update completed successfully.
Sep 22 15:50:21 devstack sudo[100611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD
Sep 22 15:50:21 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:21 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] a1740871-5367-428b-bac9-1a5ec1bb8377 was qcow2, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:50:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:21 devstack sudo[100618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c
Sep 22 15:50:21 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:24 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c" returned: 0 in 2.907s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:24 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_dfqjzc1jdevstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:50:24 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Converted 112.00 MB image at 38.49 MB/s
Sep 22 15:50:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:24 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c 1G
Sep 22 15:50:24 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:25 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c 1G" returned: 0 in 0.457s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Downloaded image a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 13aa44d2-7dae-4644-bede-99f8520f829c successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 for user a467037bec184d88b9bacab8491b1855 is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Marking volume 13aa44d2-7dae-4644-bede-99f8520f829c as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Copying metadata from image a1740871-5367-428b-bac9-1a5ec1bb8377 to 13aa44d2-7dae-4644-bede-99f8520f829c. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Creating volume glance metadata for volume 13aa44d2-7dae-4644-bede-99f8520f829c backed by image a1740871-5367-428b-bac9-1a5ec1bb8377 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0ac710-0985-4dc5-b8e5-82dfc1bac9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13aa44d2-7dae-4644-bede-99f8520f829c', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd29477980>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe67470-e256-4bd1-95d8-9e92e59ebb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:25 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Volume volume-13aa44d2-7dae-4644-bede-99f8520f829c (13aa44d2-7dae-4644-bede-99f8520f829c): created successfully
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe67470-e256-4bd1-95d8-9e92e59ebb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (d398a5c4-6adc-4cbf-bdf6-69ddf493846c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:25 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-95f96b14-b18e-48a2-a238-2173618fa3e1 tempest-VolumesGetTest-1760875235 None] Created volume successfully.
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (1fb12632-3928-42ed-a227-b2e29996950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcafae3-0ed2-4323-9d19-c8be8d2c3242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcafae3-0ed2-4323-9d19-c8be8d2c3242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1974426342',display_name='tempest-VolumesGetTest-Volume-1962700038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916907d4-6356-4fc2-93f9-923455d0b3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:27Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7e1d20-e9ba-4102-9ce2-f7a04515ed61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7e1d20-e9ba-4102-9ce2-f7a04515ed61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7a46ef-a3a1-45f4-a23c-075b06d7bf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7a46ef-a3a1-45f4-a23c-075b06d7bf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916907d4-6356-4fc2-93f9-923455d0b3f1', 'volume_name': 'volume-916907d4-6356-4fc2-93f9-923455d0b3f1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4507c0fd-0a44-467a-84c9-e4854f555ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4507c0fd-0a44-467a-84c9-e4854f555ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9363092c-1f1c-4b9c-9687-e465237a9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Volume 916907d4-6356-4fc2-93f9-923455d0b3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916907d4-6356-4fc2-93f9-923455d0b3f1', 'volume_size': 1}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1974426342',display_name='tempest-VolumesGetTest-Volume-1962700038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916907d4-6356-4fc2-93f9-923455d0b3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32dea03eb7b4a7399af8d00933fab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:27Z,use_quota=True,user_id='a467037bec184d88b9bacab8491b1855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Creating volume 916907d4-6356-4fc2-93f9-923455d0b3f1 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:27 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:27 devstack sudo[100665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1 1073741824
Sep 22 15:50:27 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Flow 'volume_create_manager' (54b86802-a02f-4bab-a5f8-dce32f7aa023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb0953f-a101-4a1f-9a05-f5a7e043eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb0953f-a101-4a1f-9a05-f5a7e043eaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec42ff5-763c-452e-b578-434f4a30cca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d3a008d7c14247b4d7ce3ef138bed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:28Z,use_quota=True,user_id='b7dda13675064b16b1edf9ed974acb13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b3a7bf-6a04-48a9-874a-46008e6f3779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b3a7bf-6a04-48a9-874a-46008e6f3779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c68e1b0-eca6-4004-bac3-23c807148ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c68e1b0-eca6-4004-bac3-23c807148ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec42ff5-763c-452e-b578-434f4a30cca4', 'volume_name': 'volume-9ec42ff5-763c-452e-b578-434f4a30cca4', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264cf18e-044b-4690-85d2-12489ce47d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264cf18e-044b-4690-85d2-12489ce47d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc46de12-868a-4b5b-a75d-e375f595e647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:27 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Volume 9ec42ff5-763c-452e-b578-434f4a30cca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec42ff5-763c-452e-b578-434f4a30cca4', 'volume_size': 1}
Sep 22 15:50:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:28 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1 1073741824" returned: 0 in 0.711s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:28 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1
Sep 22 15:50:28 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:28 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1" returned: 0 in 0.310s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec42ff5-763c-452e-b578-434f4a30cca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d3a008d7c14247b4d7ce3ef138bed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:28Z,use_quota=True,user_id='b7dda13675064b16b1edf9ed974acb13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Creating volume 9ec42ff5-763c-452e-b578-434f4a30cca4 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:28 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9363092c-1f1c-4b9c-9687-e465237a9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916907d4-6356-4fc2-93f9-923455d0b3f1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:28 devstack sudo[100679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4 1073741824
Sep 22 15:50:28 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb34ac5-b141-4588-ad5d-fa42177bdafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:28 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Volume volume-916907d4-6356-4fc2-93f9-923455d0b3f1 (916907d4-6356-4fc2-93f9-923455d0b3f1): created successfully
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb34ac5-b141-4588-ad5d-fa42177bdafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Flow 'volume_create_manager' (1fb12632-3928-42ed-a227-b2e29996950c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:28 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-6ac7b68c-79eb-479a-8ccd-871a9b76bd79 req-ef476ea1-467a-4cf3-b531-68a54445b776 tempest-TestInstancesWithCinderVolumes-788792293 None] Terminate volume connection completed successfully.
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-6ac7b68c-79eb-479a-8ccd-871a9b76bd79 req-ef476ea1-467a-4cf3-b531-68a54445b776 tempest-TestInstancesWithCinderVolumes-788792293 None] Deleting attachment fd752ba7-9576-4249-8224-ee4f00dbb227. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:50:28 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d2d612d6-0e31-443d-8fb9-295b4fd5853b tempest-VolumesGetTest-1760875235 None] Created volume successfully.
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:28 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:28 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:28 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4 1073741824" returned: 0 in 0.519s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:28 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4
Sep 22 15:50:28 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:28 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.280s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:28 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 28 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "cinder-411fae03-b627-4fd6-b1fb-4cfda6837a25-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-411fae03-b627-4fd6-b1fb-4cfda6837a25-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:29 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4" returned: 0 in 0.264s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc46de12-868a-4b5b-a75d-e375f595e647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec42ff5-763c-452e-b578-434f4a30cca4', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feaad571-5957-4416-968f-ac94a495d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "cinder-quobyte-411fae03-b627-4fd6-b1fb-4cfda6837a25" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:29 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Volume volume-9ec42ff5-763c-452e-b578-434f4a30cca4 (9ec42ff5-763c-452e-b578-434f4a30cca4): created successfully
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feaad571-5957-4416-968f-ac94a495d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Flow 'volume_create_manager' (54b86802-a02f-4bab-a5f8-dce32f7aa023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-quobyte-411fae03-b627-4fd6-b1fb-4cfda6837a25" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b2a7cf20-5f88-4172-a8f1-7a47091b1e99 tempest-CinderUnicodeTest-1592713043 None] Created volume successfully.
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04d0455-32ec-46a8-b586-f8d2c9fb095f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:29 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25
Sep 22 15:50:29 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-916907d4-6356-4fc2-93f9-923455d0b3f1-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Lock "cinder-916907d4-6356-4fc2-93f9-923455d0b3f1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-quobyte-916907d4-6356-4fc2-93f9-923455d0b3f1" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-916907d4-6356-4fc2-93f9-923455d0b3f1" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c2d90f-ff5c-4e07-ac0c-8f5b349ad35d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:29 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25" returned: 0 in 0.552s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:29 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25
Sep 22 15:50:29 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:30 devstack sudo[100702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1
Sep 22 15:50:30 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:30 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-411fae03-b627-4fd6-b1fb-4cfda6837a25" returned: 0 in 0.415s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-quobyte-411fae03-b627-4fd6-b1fb-4cfda6837a25" released by "delete_volume" :: held 1.039s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:30 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1" returned: 0 in 0.551s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:30 devstack cinder-volume[85987]: WARNING cinder.quota [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1089937534-1208865261 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1089937534-1208865261, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:50:30 devstack cinder-volume[85987]: WARNING cinder.quota [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1089937534-1208865261 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1089937534-1208865261, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:50:30 devstack sudo[100711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1
Sep 22 15:50:30 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Created reservations ['ad6337ba-c825-4568-bc65-6dca1c67b64d', '72dbe7cb-5a61-40b3-8fe7-565889f286fb', 'c851aba5-87c4-4c0b-ab12-136e6307df60', '826ebb60-7310-4835-9d32-9172fa77773b'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:30 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:30 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:30 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-916907d4-6356-4fc2-93f9-923455d0b3f1" returned: 0 in 0.449s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-916907d4-6356-4fc2-93f9-923455d0b3f1" released by "delete_volume" :: held 1.083s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:30 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.327s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:30 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Deleted volume successfully.
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Flow 'volume_create_manager' (934d2885-8ec6-437a-9f8f-e0b8ab3c99c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8e4357-119a-4cd3-a1ee-c1b7e5023362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8e4357-119a-4cd3-a1ee-c1b7e5023362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1918581194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22042fe-d6eb-4285-b6dc-bbc68f775a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d3a008d7c14247b4d7ce3ef138bed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:31Z,use_quota=True,user_id='b7dda13675064b16b1edf9ed974acb13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bbce76-9e60-4cb0-8d78-b38ffdc2d284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bbce76-9e60-4cb0-8d78-b38ffdc2d284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7e01f8-15cc-4f78-bffb-fce3180b9de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7e01f8-15cc-4f78-bffb-fce3180b9de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22042fe-d6eb-4285-b6dc-bbc68f775a7d', 'volume_name': 'volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a956ee1b-2fbf-4651-acb8-673194fb3fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a956ee1b-2fbf-4651-acb8-673194fb3fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cf8d29-492f-4559-970f-8a9a68a45b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:30 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Volume d22042fe-d6eb-4285-b6dc-bbc68f775a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d', 'volume_size': 1}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1918581194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22042fe-d6eb-4285-b6dc-bbc68f775a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d3a008d7c14247b4d7ce3ef138bed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:31Z,use_quota=True,user_id='b7dda13675064b16b1edf9ed974acb13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Creating volume d22042fe-d6eb-4285-b6dc-bbc68f775a7d {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:30 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-390deff3-9079-448a-b899-c79fed11830b tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-411fae03-b627-4fd6-b1fb-4cfda6837a25-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:31 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d 1073741824
Sep 22 15:50:31 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Created reservations ['07756663-4c69-40d5-93bf-265ebf8d2066', 'f8fde977-e1e9-465f-953b-be60bf6a6b91', 'f9195875-de57-4ff1-9aee-ed4dc6eceb27', '30bba3a5-839c-4033-b9df-bb2128dd466d'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:31 devstack sudo[100719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:31 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:31 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.417s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:31 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Deleted volume successfully.
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-30f39410-40b3-41c5-83b9-de6f87907e76 tempest-VolumesGetTest-1760875235 None] Lock "cinder-916907d4-6356-4fc2-93f9-923455d0b3f1-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:31 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d 1073741824" returned: 0 in 0.698s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:31 devstack sudo[100726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d
Sep 22 15:50:31 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:32 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" returned: 0 in 0.281s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cf8d29-492f-4559-970f-8a9a68a45b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ae1107-818c-4b11-adab-5dad72781edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-13aa44d2-7dae-4644-bede-99f8520f829c-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:32 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Volume volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d (d22042fe-d6eb-4285-b6dc-bbc68f775a7d): created successfully
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ae1107-818c-4b11-adab-5dad72781edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Flow 'volume_create_manager' (934d2885-8ec6-437a-9f8f-e0b8ab3c99c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Lock "cinder-13aa44d2-7dae-4644-bede-99f8520f829c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a3900d8b-d6a6-43bd-90d5-7d7999ae959c tempest-CinderUnicodeTest-1592713043 None] Created volume successfully.
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Acquiring lock "cinder-quobyte-13aa44d2-7dae-4644-bede-99f8520f829c" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-13aa44d2-7dae-4644-bede-99f8520f829c" acquired by "delete_volume" :: waited 0.014s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[417bcc25-3444-4bf8-91bc-e3711648fa91]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:32 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c
Sep 22 15:50:32 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:32 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c" returned: 0 in 0.428s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:32 devstack sudo[100749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c
Sep 22 15:50:32 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:32 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-13aa44d2-7dae-4644-bede-99f8520f829c" returned: 0 in 0.334s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Lock "cinder-quobyte-13aa44d2-7dae-4644-bede-99f8520f829c" released by "delete_volume" :: held 0.821s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Created reservations ['2d05ae40-e48d-4bfd-9d43-5de948a984b9', 'c1ef4486-7ee3-47ce-8f8f-fa8463611cff', 'f43d34af-c883-4df0-af7b-d2f75c7ac634', 'a57a8f71-e858-4596-af91-20026494dc01'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:33 devstack sudo[100758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:33 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Creating offline snapshot aa7b4792-10fd-42c0-860a-8dd381f4a04c of volume d22042fe-d6eb-4285-b6dc-bbc68f775a7d {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[15079c7f-4bdf-441e-989b-9be5f1355bdf]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:33 devstack sudo[100760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d
Sep 22 15:50:33 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:33 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.486s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:33 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Deleted volume successfully.
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9b528571-d109-4368-8bbe-f1d251bf5f1b tempest-VolumesGetTest-1760875235 None] Lock "cinder-13aa44d2-7dae-4644-bede-99f8520f829c-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:33 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" returned: 0 in 0.563s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:33 devstack sudo[100767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c 1G
Sep 22 15:50:33 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:34 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-1e1d07b8-ea74-4478-8202-765357a58fae req-0b746c4b-b5a1-428b-bf2e-5c4d1aae468f tempest-TestInstancesWithCinderVolumes-788792293 None] Terminate volume connection completed successfully.
Sep 22 15:50:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-1e1d07b8-ea74-4478-8202-765357a58fae req-0b746c4b-b5a1-428b-bf2e-5c4d1aae468f tempest-TestInstancesWithCinderVolumes-788792293 None] Deleting attachment bb61ee15-67e4-4c1d-baa4-2bb501e664b2. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:50:34 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c 1G" returned: 0 in 0.552s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:34 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c
Sep 22 15:50:34 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "cinder-acc2a959-70fe-423c-bf9a-0ae8039df205-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-acc2a959-70fe-423c-bf9a-0ae8039df205-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:34 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c" returned: 0 in 0.396s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:34 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c is being set with open permissions: ugo+rw
Sep 22 15:50:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:34 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c
Sep 22 15:50:34 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "cinder-quobyte-acc2a959-70fe-423c-bf9a-0ae8039df205" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-quobyte-acc2a959-70fe-423c-bf9a-0ae8039df205" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[054886dd-ca44-4de3-9caf-c68eb3531e62]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:35 devstack sudo[100783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205
Sep 22 15:50:35 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:35 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c" returned: 0 in 0.520s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:35 devstack sudo[100788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.info
Sep 22 15:50:35 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:35 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205" returned: 0 in 0.592s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:35 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205
Sep 22 15:50:35 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:35 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.info" returned: 0 in 0.406s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:35 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.info is being set with open permissions: ugo+rw
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:35 devstack sudo[100795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.info
Sep 22 15:50:35 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:35 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-acc2a959-70fe-423c-bf9a-0ae8039df205" returned: 0 in 0.358s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-quobyte-acc2a959-70fe-423c-bf9a-0ae8039df205" released by "delete_volume" :: held 1.034s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:36 devstack cinder-volume[85987]: WARNING cinder.quota [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1789946788-436711614 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1789946788-436711614, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:50:36 devstack cinder-volume[85987]: WARNING cinder.quota [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1789946788-436711614 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1789946788-436711614, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Created reservations ['40356b35-de1a-4365-89fe-3428e1681b70', 'c613b8b5-e275-4ae2-9357-d4d4b2960cfd', '8844098d-3411-4f40-a2e8-ee84d27cdb01', '0cb64303-7ed8-4360-953d-19cc390de9c6'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:36 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.info" returned: 0 in 0.367s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.981s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:36 devstack sudo[100799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:36 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-acf97b98-ac57-48b3-8211-70e19599a48a tempest-CinderUnicodeTest-1592713043 None] Create snapshot completed successfully
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "cinder-aa7b4792-10fd-42c0-860a-8dd381f4a04c-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-aa7b4792-10fd-42c0-860a-8dd381f4a04c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "cinder-quobyte-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-quobyte-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "cinder-quobyte-aa7b4792-10fd-42c0-860a-8dd381f4a04c" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-quobyte-aa7b4792-10fd-42c0-860a-8dd381f4a04c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Deleting offline snapshot aa7b4792-10fd-42c0-860a-8dd381f4a04c of volume d22042fe-d6eb-4285-b6dc-bbc68f775a7d {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] snapshot_file for this snap is: volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f74a2b3-0ec3-4a15-ba58-fc396ba46c04]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:36 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.609s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:36 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Deleted volume successfully.
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d8539bd2-b0f0-430f-9ce4-2ad7e2d859b7 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-acc2a959-70fe-423c-bf9a-0ae8039df205-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:37 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c
Sep 22 15:50:37 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Flow 'volume_create_manager' (bd8aa979-9800-45a3-9f08-a06fd91c1c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0db1711-b480-44d6-b408-fe09732fa1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0db1711-b480-44d6-b408-fe09732fa1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1740577751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b2fa75-0e24-4d71-8164-2b56e5f5683c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edb136ab3244713bee5a88babaa6550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:37Z,use_quota=True,user_id='48fa74f18e6a432a9ef12c7e24398ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334222fb-4d98-4c1e-abe4-5197e7d75dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334222fb-4d98-4c1e-abe4-5197e7d75dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4075b4-32c1-40fa-9433-d9fa322172e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4075b4-32c1-40fa-9433-d9fa322172e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b2fa75-0e24-4d71-8164-2b56e5f5683c', 'volume_name': 'volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b796a18-4636-4b6c-b5d6-4690007b65f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b796a18-4636-4b6c-b5d6-4690007b65f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11074bef-a655-467f-9424-ea66719c02c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:37 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Volume 52b2fa75-0e24-4d71-8164-2b56e5f5683c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c', 'volume_size': 1}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1740577751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b2fa75-0e24-4d71-8164-2b56e5f5683c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edb136ab3244713bee5a88babaa6550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:37Z,use_quota=True,user_id='48fa74f18e6a432a9ef12c7e24398ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Creating volume 52b2fa75-0e24-4d71-8164-2b56e5f5683c {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:37 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:37 devstack sudo[100807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c 1073741824
Sep 22 15:50:37 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:37 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c" returned: 0 in 0.853s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[def67ff9-770e-48a4-ac34-92731f87d70c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Flow 'volume_create_manager' (865dda4b-e42e-4093-863f-be2eff778993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbeb1ff-b3f5-4ac7-88b1-d463ac598fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:37 devstack sudo[100812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d
Sep 22 15:50:37 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbeb1ff-b3f5-4ac7-88b1-d463ac598fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1794292858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a3e2de-2fed-4f59-a5fb-7ed5e2932583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edb136ab3244713bee5a88babaa6550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:38Z,use_quota=True,user_id='48fa74f18e6a432a9ef12c7e24398ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50306aa2-7158-4fda-ba52-308ea255fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50306aa2-7158-4fda-ba52-308ea255fa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e540cb9-50ba-43a1-bc08-db9d0917f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e540cb9-50ba-43a1-bc08-db9d0917f324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a3e2de-2fed-4f59-a5fb-7ed5e2932583', 'volume_name': 'volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c0f022-2f89-43ad-945d-b9b526a0d048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c0f022-2f89-43ad-945d-b9b526a0d048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7583761-06ee-494e-b413-74308df03e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Volume 24a3e2de-2fed-4f59-a5fb-7ed5e2932583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583', 'volume_size': 1}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:38 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c 1073741824" returned: 0 in 0.815s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:38 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c
Sep 22 15:50:38 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:38 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" returned: 0 in 0.730s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:38 devstack sudo[100823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c
Sep 22 15:50:38 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:38 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c" returned: 0 in 0.382s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1794292858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a3e2de-2fed-4f59-a5fb-7ed5e2932583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edb136ab3244713bee5a88babaa6550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:38Z,use_quota=True,user_id='48fa74f18e6a432a9ef12c7e24398ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Creating volume 24a3e2de-2fed-4f59-a5fb-7ed5e2932583 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:38 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:38 devstack sudo[100827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583 1073741824
Sep 22 15:50:38 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11074bef-a655-467f-9424-ea66719c02c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188cc978-c861-49a6-a675-29b88d2e7b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Volume volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c (52b2fa75-0e24-4d71-8164-2b56e5f5683c): created successfully
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188cc978-c861-49a6-a675-29b88d2e7b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Flow 'volume_create_manager' (bd8aa979-9800-45a3-9f08-a06fd91c1c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-58389435-f88b-41c1-be77-210fd61bf8f3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Created volume successfully.
Sep 22 15:50:39 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c" returned: 0 in 0.600s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:39 devstack sudo[100831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c
Sep 22 15:50:39 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:39 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583 1073741824" returned: 0 in 0.661s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:39 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d.aa7b4792-10fd-42c0-860a-8dd381f4a04c" returned: 0 in 0.478s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:39 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583
Sep 22 15:50:39 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-quobyte-aa7b4792-10fd-42c0-860a-8dd381f4a04c" released by "_delete_snapshot" :: held 2.885s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-quobyte-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" released by "delete_snapshot" :: held 2.937s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:39 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Created reservations ['6b96e4de-6b77-4b5f-8b74-35bc1b3cba47', '7ca3bb1c-e1a3-4ce0-80aa-d6d8fef3a1b0', '6314c9d3-eeee-434a-9b30-37e70a1b59ad', '08b6bcea-0049-4263-8f6d-c87c2a0b1e44'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Delete snapshot completed successfully.
Sep 22 15:50:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-89928c06-bfd7-4c02-a1b9-69b3a4e47b4f tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-aa7b4792-10fd-42c0-860a-8dd381f4a04c-delete_snapshot" released by "delete_snapshot" :: held 3.369s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:40 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583" returned: 0 in 0.583s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7583761-06ee-494e-b413-74308df03e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb519b3-edc6-4642-8257-8a9ed6460d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:40 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Volume volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583 (24a3e2de-2fed-4f59-a5fb-7ed5e2932583): created successfully
Sep 22 15:50:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb519b3-edc6-4642-8257-8a9ed6460d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Flow 'volume_create_manager' (865dda4b-e42e-4093-863f-be2eff778993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-15345c3a-c60f-43b9-95e7-c007fc0d2e25 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Created volume successfully.
Sep 22 15:50:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "cinder-d22042fe-d6eb-4285-b6dc-bbc68f775a7d-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-d22042fe-d6eb-4285-b6dc-bbc68f775a7d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "cinder-quobyte-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-quobyte-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2457a0-9f3e-4547-a959-26a0481d0168]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:50:41 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Flow 'volume_create_manager' (b12fb713-5498-4988-8185-3caa5e4c09db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:41 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cea3cf-bad2-4d7c-87de-46797501ca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cea3cf-bad2-4d7c-87de-46797501ca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2102363102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b1acee-d8df-4b17-8333-4b8d17bed5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4aea51fe14458c9c249bb288798763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:41Z,use_quota=True,user_id='67cc0809c07a4bc5a073cd84687143d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1970e5d5-788a-4fd2-94b9-032f2759428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1970e5d5-788a-4fd2-94b9-032f2759428b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bdee8d-0057-491a-9d6d-4e88c2106bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bdee8d-0057-491a-9d6d-4e88c2106bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b1acee-d8df-4b17-8333-4b8d17bed5fe', 'volume_name': 'volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1936b9bc-0844-4ce8-9a97-2586d3148533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1936b9bc-0844-4ce8-9a97-2586d3148533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a432f53-4f2e-4a29-8fbc-61647740927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:41 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Volume 03b1acee-d8df-4b17-8333-4b8d17bed5fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe', 'volume_size': 1}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2102363102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b1acee-d8df-4b17-8333-4b8d17bed5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4aea51fe14458c9c249bb288798763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:50:41Z,use_quota=True,user_id='67cc0809c07a4bc5a073cd84687143d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Creating volume 03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:50:41 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:41 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe 1073741824
Sep 22 15:50:41 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:41 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" returned: 0 in 0.498s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:41 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d
Sep 22 15:50:41 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:42 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" returned: 0 in 0.477s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-quobyte-d22042fe-d6eb-4285-b6dc-bbc68f775a7d" released by "delete_volume" :: held 1.069s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:42 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe 1073741824" returned: 0 in 0.829s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Created reservations ['5fcb2f54-3887-4387-bfa6-bebdc03199af', '92d65b91-5085-4085-81cc-df5c95e6030d', 'aa19c817-45d4-4212-bd63-034fde492989', '5a818ec2-1dd6-40dd-a235-e87016d45bc2'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:42 devstack sudo[100881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe
Sep 22 15:50:42 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-0587610e-558c-4c27-9e46-cdd26b528d3f req-d54479dc-9572-4524-8587-46e18b35f472 tempest-TestInstancesWithCinderVolumes-788792293 None] Terminate volume connection completed successfully.
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-0587610e-558c-4c27-9e46-cdd26b528d3f req-d54479dc-9572-4524-8587-46e18b35f472 tempest-TestInstancesWithCinderVolumes-788792293 None] Deleting attachment d28fb706-ecd4-4b55-8e4d-5116f00a2a2b. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:42 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:42 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:42 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe" returned: 0 in 0.337s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a432f53-4f2e-4a29-8fbc-61647740927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83f7cb0-d089-4437-8acb-c1d5774a82ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:50:42 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:42 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Volume volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe (03b1acee-d8df-4b17-8333-4b8d17bed5fe): created successfully
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83f7cb0-d089-4437-8acb-c1d5774a82ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Flow 'volume_create_manager' (b12fb713-5498-4988-8185-3caa5e4c09db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.306s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Deleted volume successfully.
Sep 22 15:50:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d411e115-42ef-439e-b5da-96299cdd6a86 tempest-VolumesSnapshotListTestJSON-503964584 None] Created volume successfully.
Sep 22 15:50:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-27d114d1-7bc1-46ae-9893-2ec0411e2df3 tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-d22042fe-d6eb-4285-b6dc-bbc68f775a7d-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "cinder-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "cinder-quobyte-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-quobyte-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "cinder-9ec42ff5-763c-452e-b578-434f4a30cca4-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-9ec42ff5-763c-452e-b578-434f4a30cca4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9735b71-5786-45c3-a103-822851b5ebeb]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "cinder-quobyte-9ec42ff5-763c-452e-b578-434f4a30cca4" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-quobyte-9ec42ff5-763c-452e-b578-434f4a30cca4" acquired by "delete_volume" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:43 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32
Sep 22 15:50:43 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e1baff-3f22-4675-88cb-e971646ac3a1]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:43 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4
Sep 22 15:50:43 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Creating offline snapshot 3c1e3ded-0b9f-4309-a754-ac9eca0e07ed of volume 03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcc867d-b91d-4726-8a2a-f4490c5ebce6]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:43 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32" returned: 0 in 0.470s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:43 devstack sudo[100898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32
Sep 22 15:50:43 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:43 devstack sudo[100897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe
Sep 22 15:50:43 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:44 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4" returned: 0 in 0.504s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:44 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4
Sep 22 15:50:44 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:44 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32" returned: 0 in 0.394s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-quobyte-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32" released by "delete_volume" :: held 0.949s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:44 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe" returned: 0 in 0.504s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:44 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed 1G
Sep 22 15:50:44 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:44 devstack cinder-volume[85987]: WARNING cinder.quota [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1178139951-617937260 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1178139951-617937260, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:50:44 devstack cinder-volume[85987]: WARNING cinder.quota [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1178139951-617937260 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1178139951-617937260, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:50:44 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9ec42ff5-763c-452e-b578-434f4a30cca4" returned: 0 in 0.313s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Created reservations ['ef5edbc1-93d9-4fac-bfdc-b356c7b08b22', '62b25926-08be-41b0-bd83-110fad262fbc', 'f4ff66de-e2fc-47fb-9692-9bfb7b5f195c', '6afa851b-1f3a-4fd2-a75c-7c8a9c43f571'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-quobyte-9ec42ff5-763c-452e-b578-434f4a30cca4" released by "delete_volume" :: held 0.881s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Created reservations ['d6a5decc-52b1-4783-b8c7-abf9f581de09', '5ae28531-932a-4bdb-900a-2504f1132869', '4a553780-267d-414c-9a4e-4539723edb41', '9127a356-71ec-4223-a7ab-2f0dc2f6e6ff'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:44 devstack sudo[100914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:44 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:44 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:50:44 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:45 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:45 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed 1G" returned: 0 in 0.692s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:45 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.472s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.346s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:50:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Deleted volume successfully.
Sep 22 15:50:45 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed
Sep 22 15:50:45 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9ac5ad73-4b58-48c9-b96b-83a9850e8c22 tempest-TestInstancesWithCinderVolumes-788792293 None] Lock "cinder-6c9e93de-240c-42dd-bf0e-2c9d39fd1b32-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Deleted volume successfully.
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-88a4e059-b90e-4c0b-89ed-39d059e66375 tempest-CinderUnicodeTest-1592713043 None] Lock "cinder-9ec42ff5-763c-452e-b578-434f4a30cca4-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:45 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" returned: 0 in 0.347s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:45 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed is being set with open permissions: ugo+rw
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:45 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed
Sep 22 15:50:45 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:45 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" returned: 0 in 0.509s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:45 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.info
Sep 22 15:50:45 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:46 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.info" returned: 0 in 0.360s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:46 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.info is being set with open permissions: ugo+rw
Sep 22 15:50:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:46 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.info
Sep 22 15:50:46 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:46 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.info" returned: 0 in 0.399s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.969s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0579738b-7d99-46ee-84c8-47b23358f9a3 tempest-VolumesSnapshotListTestJSON-503964584 None] Create snapshot completed successfully
Sep 22 15:50:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Creating offline snapshot 7c63754c-a7e9-47d5-8f91-775846d16779 of volume 03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:50:47 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[32577c97-cdad-4ebf-a3f7-072be094e12a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:47 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed
Sep 22 15:50:47 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:47 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" returned: 0 in 0.471s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:50:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:47 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 1G
Sep 22 15:50:47 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:48 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 1G" returned: 0 in 0.733s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:48 devstack sudo[100969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779
Sep 22 15:50:48 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:49 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779" returned: 0 in 0.688s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:49 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 is being set with open permissions: ugo+rw
Sep 22 15:50:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:49 devstack sudo[101015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779
Sep 22 15:50:49 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:49 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779" returned: 0 in 0.546s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-23c14d24-c568-424f-827f-8349d4326cf7 tempest-VolumesSnapshotListTestJSON-503964584 None] Create snapshot completed successfully
Sep 22 15:50:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:50:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:50:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Creating offline snapshot 6acef67d-e3c9-4d11-b519-a9724524f698 of volume 03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:50:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38de59e-4ff6-4b41-8d79-b812a0fc3658]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:51 devstack sudo[101048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779
Sep 22 15:50:51 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:51 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779" returned: 0 in 0.564s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:50:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:51 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 1G
Sep 22 15:50:51 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:52 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 1G" returned: 0 in 0.979s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:52 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698
Sep 22 15:50:52 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:53 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698" returned: 0 in 0.447s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:53 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 is being set with open permissions: ugo+rw
Sep 22 15:50:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:53 devstack sudo[101065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698
Sep 22 15:50:53 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:53 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698" returned: 0 in 0.546s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.780s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:50:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5eeebd1e-efea-4167-a15b-6be7e39a6cdf tempest-VolumesSnapshotListTestJSON-503964584 None] Create snapshot completed successfully
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-6acef67d-e3c9-4d11-b519-a9724524f698-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-6acef67d-e3c9-4d11-b519-a9724524f698-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-quobyte-6acef67d-e3c9-4d11-b519-a9724524f698" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-6acef67d-e3c9-4d11-b519-a9724524f698" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Deleting offline snapshot 6acef67d-e3c9-4d11-b519-a9724524f698 of volume 03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] snapshot_file for this snap is: volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4521223b-7104-4137-8a93-a509cec7b8c1]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:56 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698
Sep 22 15:50:56 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:56 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698" returned: 0 in 0.517s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:50:56 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9010c12-3b88-4db2-9cb2-622af4660416]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:56 devstack sudo[101076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779
Sep 22 15:50:56 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:57 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779" returned: 0 in 0.696s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:50:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:57 devstack sudo[101081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698
Sep 22 15:50:57 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:57 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698" returned: 0 in 0.493s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:57 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698
Sep 22 15:50:57 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:57 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.6acef67d-e3c9-4d11-b519-a9724524f698" returned: 0 in 0.298s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-6acef67d-e3c9-4d11-b519-a9724524f698" released by "_delete_snapshot" :: held 2.160s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" released by "delete_snapshot" :: held 2.204s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:58 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Created reservations ['6032655f-5357-432c-8d36-2f1b8317fbac', 'd1c767ca-8874-43ef-8553-1df4b7858c3c', '101d7144-84ac-4d22-a6dd-bc5c24542fdd', '03d596f5-0b05-4ee0-ad67-8821ef34def6'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:50:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Delete snapshot completed successfully.
Sep 22 15:50:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2b2c600f-0137-4df1-ac8e-d74faae118fe tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-6acef67d-e3c9-4d11-b519-a9724524f698-delete_snapshot" released by "delete_snapshot" :: held 2.412s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-7c63754c-a7e9-47d5-8f91-775846d16779-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-7c63754c-a7e9-47d5-8f91-775846d16779-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-quobyte-7c63754c-a7e9-47d5-8f91-775846d16779" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-7c63754c-a7e9-47d5-8f91-775846d16779" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Deleting offline snapshot 7c63754c-a7e9-47d5-8f91-775846d16779 of volume 03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] snapshot_file for this snap is: volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee100f1-0f7b-44bb-8fef-753d15e556a0]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:59 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779
Sep 22 15:50:59 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:50:59 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779" returned: 0 in 0.509s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[193c8ceb-d488-4396-a934-fc46aa2eea7a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:50:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:50:59 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed
Sep 22 15:50:59 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:00 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" returned: 0 in 0.471s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:51:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:00 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779
Sep 22 15:51:00 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:00 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779" returned: 0 in 0.463s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:00 devstack sudo[101109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779
Sep 22 15:51:00 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:00 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.7c63754c-a7e9-47d5-8f91-775846d16779" returned: 0 in 0.266s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-7c63754c-a7e9-47d5-8f91-775846d16779" released by "_delete_snapshot" :: held 1.844s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" released by "delete_snapshot" :: held 1.873s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=185,cinder:DELETE=17,cinder:SELECT=136,cinder:INSERT=42 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=193,cinder:SELECT=168,cinder:INSERT=61,cinder:DELETE=15 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Created reservations ['b0a1ec74-5614-4db2-be8c-b4d635d43d19', '28d375bc-ca43-4549-81f2-81aef9b47920', '6fa5aff0-e67f-4003-937e-7cadcda3a085', '98b2bb89-e08d-4694-a78e-1b66dc7b95a4'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:51:01 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Delete snapshot completed successfully.
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0eb17f2-f418-463e-904a-048452a344b3 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-7c63754c-a7e9-47d5-8f91-775846d16779-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-3c1e3ded-0b9f-4309-a754-ac9eca0e07ed-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-3c1e3ded-0b9f-4309-a754-ac9eca0e07ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-quobyte-3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Deleting offline snapshot 3c1e3ded-0b9f-4309-a754-ac9eca0e07ed of volume 03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] snapshot_file for this snap is: volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[898ba633-c924-467a-9904-e0153799166b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:01 devstack sudo[101112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed
Sep 22 15:51:01 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:01 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" returned: 0 in 0.422s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a5aec-9d5d-4973-8a6f-e39352708580]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:51:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:01 devstack sudo[101119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe
Sep 22 15:51:01 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:02 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe" returned: 0 in 0.383s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:02 devstack sudo[101124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed
Sep 22 15:51:02 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:02 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" returned: 0 in 0.372s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:02 devstack sudo[101130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed
Sep 22 15:51:02 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:02 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe.3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" returned: 0 in 0.280s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-3c1e3ded-0b9f-4309-a754-ac9eca0e07ed" released by "_delete_snapshot" :: held 1.593s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" released by "delete_snapshot" :: held 1.622s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:03 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Created reservations ['c664b584-2cd1-4a15-95b9-5c1b01b99f08', '2cd337c5-2999-40fb-b2e7-c2fb0419669a', '99ab40f6-c918-4fd8-9b7f-0da4b19b068c', 'f0243b99-28c0-47b9-b1bd-3173368ee563'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:51:03 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Delete snapshot completed successfully.
Sep 22 15:51:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f5b95b03-8576-4862-93ff-1769e19a7837 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-3c1e3ded-0b9f-4309-a754-ac9eca0e07ed-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-03b1acee-d8df-4b17-8333-4b8d17bed5fe-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:51:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-03b1acee-d8df-4b17-8333-4b8d17bed5fe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:51:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:51:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:51:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce056ca-af90-4690-89ce-f8a5f3dfc67b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:51:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:03 devstack sudo[101149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe
Sep 22 15:51:03 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:04 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe" returned: 0 in 0.386s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:04 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe
Sep 22 15:51:04 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:04 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-03b1acee-d8df-4b17-8333-4b8d17bed5fe" returned: 0 in 0.256s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-quobyte-03b1acee-d8df-4b17-8333-4b8d17bed5fe" released by "delete_volume" :: held 0.709s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Created reservations ['4e9e1697-2559-4d88-a450-2dd54465f7de', 'fd964657-d693-4b57-ab5d-d8edb8e0ae31', '8e4ce731-c884-4b87-b291-9861e9df1337', 'e6e1576a-52b7-43ad-9054-e5acc65c4562'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:04 devstack sudo[101157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:51:04 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:04 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:51:04 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Deleted volume successfully.
Sep 22 15:51:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4b24b1cd-9140-47e1-9215-ffd1f3205469 tempest-VolumesSnapshotListTestJSON-503964584 None] Lock "cinder-03b1acee-d8df-4b17-8333-4b8d17bed5fe-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:14 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=20 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:51:14 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:51:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-97f20b34-be3a-4915-a902-d1b6ac8cf84d req-8e4bc616-cd45-40b4-8ec1-673dd827948f tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:51:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-97f20b34-be3a-4915-a902-d1b6ac8cf84d req-8e4bc616-cd45-40b4-8ec1-673dd827948f tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:51:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-97f20b34-be3a-4915-a902-d1b6ac8cf84d req-8e4bc616-cd45-40b4-8ec1-673dd827948f tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:51:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-97f20b34-be3a-4915-a902-d1b6ac8cf84d req-8e4bc616-cd45-40b4-8ec1-673dd827948f tempest-TestServerVolumeAttachmentScenario-2051807396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3403582-6244-4381-8f5f-90ca2c7316b2', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:51:19 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-97f20b34-be3a-4915-a902-d1b6ac8cf84d req-8e4bc616-cd45-40b4-8ec1-673dd827948f tempest-TestServerVolumeAttachmentScenario-2051807396 None] attachment_update completed successfully.
Sep 22 15:51:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-377b947a-6bd8-446f-856b-6d673b8a2a37 req-da699d36-80ed-440c-b533-0133b78ff456 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:51:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-377b947a-6bd8-446f-856b-6d673b8a2a37 req-da699d36-80ed-440c-b533-0133b78ff456 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:51:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-377b947a-6bd8-446f-856b-6d673b8a2a37 req-da699d36-80ed-440c-b533-0133b78ff456 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:51:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-377b947a-6bd8-446f-856b-6d673b8a2a37 req-da699d36-80ed-440c-b533-0133b78ff456 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04d51e92-3bad-49d9-b175-03ca4ff79aa8', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:51:24 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-377b947a-6bd8-446f-856b-6d673b8a2a37 req-da699d36-80ed-440c-b533-0133b78ff456 tempest-TestServerVolumeAttachmentScenario-2051807396 None] attachment_update completed successfully.
Sep 22 15:51:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-548f4172-07f2-41eb-98ec-832275e66768 req-061821b5-dadb-4066-a34f-45a7c393323b tempest-TestServerVolumeAttachmentScenario-2051807396 None] Terminate volume connection completed successfully.
Sep 22 15:51:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-548f4172-07f2-41eb-98ec-832275e66768 req-061821b5-dadb-4066-a34f-45a7c393323b tempest-TestServerVolumeAttachmentScenario-2051807396 None] Deleting attachment 04d51e92-3bad-49d9-b175-03ca4ff79aa8. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:51:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:51:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:51:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:51:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:51:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:51:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:51:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:28 devstack sudo[101646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:51:28 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:29 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.387s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:51:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:51:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 29 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:51:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>, <Thread(Rabbit-heartbeat, started daemon 139419795786048)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:51:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-51439c08-39bb-40f9-a8a3-266253a786a9 req-90dc03b3-d1ba-4986-a4c9-8a4b0dfcc4d9 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Terminate volume connection completed successfully.
Sep 22 15:51:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-51439c08-39bb-40f9-a8a3-266253a786a9 req-90dc03b3-d1ba-4986-a4c9-8a4b0dfcc4d9 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Deleting attachment c3403582-6244-4381-8f5f-90ca2c7316b2. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:51:35 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:51:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Flow 'volume_create_manager' (52597320-4d86-4dcb-8bc0-78bf5cecadaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:51:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e6d6cf-f201-4ebf-8580-c6e327faaa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:51:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e6d6cf-f201-4ebf-8580-c6e327faaa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-638691494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79780a5b912e434eb925b9827a6eb8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:36Z,use_quota=True,user_id='d3849c39d0894114881508050f895832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:51:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b9a4aa-9879-4912-9963-f466da852ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:51:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b9a4aa-9879-4912-9963-f466da852ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bc174f-febe-413d-84e2-0c2ef95f48c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bc174f-febe-413d-84e2-0c2ef95f48c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff', 'volume_name': 'volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a755d4-7940-4e36-9aee-a8ae02ef179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a755d4-7940-4e36-9aee-a8ae02ef179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2408b1e-b51f-46e8-9e82-0481fbc3357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:51:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Volume c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff', 'volume_size': 1}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-638691494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79780a5b912e434eb925b9827a6eb8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:51:36Z,use_quota=True,user_id='d3849c39d0894114881508050f895832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Creating volume c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:51:36 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:36 devstack sudo[101701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff 1073741824
Sep 22 15:51:36 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "cinder-24a3e2de-2fed-4f59-a5fb-7ed5e2932583-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "cinder-24a3e2de-2fed-4f59-a5fb-7ed5e2932583-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "cinder-quobyte-24a3e2de-2fed-4f59-a5fb-7ed5e2932583" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "cinder-quobyte-24a3e2de-2fed-4f59-a5fb-7ed5e2932583" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[918ea57c-7e2c-488b-aa19-f8f68ac7f02a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:36 devstack sudo[101710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583
Sep 22 15:51:36 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:36 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff 1073741824" returned: 0 in 0.581s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:36 devstack sudo[101713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff
Sep 22 15:51:36 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:36 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583" returned: 0 in 0.446s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:36 devstack sudo[101719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583
Sep 22 15:51:36 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:36 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff" returned: 0 in 0.307s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2408b1e-b51f-46e8-9e82-0481fbc3357b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:51:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a0435a-29a0-43ee-b973-88ce0b729771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:51:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Volume volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff (c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff): created successfully
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a0435a-29a0-43ee-b973-88ce0b729771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Flow 'volume_create_manager' (52597320-4d86-4dcb-8bc0-78bf5cecadaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:51:37 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9eac7e2f-0d9b-4897-a841-54f8a0a54c78 tempest-TestImageHashVerification-1585281664 None] Created volume successfully.
Sep 22 15:51:37 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-24a3e2de-2fed-4f59-a5fb-7ed5e2932583" returned: 0 in 0.286s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "cinder-quobyte-24a3e2de-2fed-4f59-a5fb-7ed5e2932583" released by "delete_volume" :: held 0.782s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Created reservations ['c236bce2-8a66-433b-923c-8d7fc5d40926', '74952a70-ca45-4727-bfef-6c9495346a38', 'a4c29171-9122-45e0-a1ee-68cb41498e64', '13a196fa-a7ba-43f9-ad4e-1d5c300c14a7'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:37 devstack sudo[101722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:51:37 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "cinder-52b2fa75-0e24-4d71-8164-2b56e5f5683c-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "cinder-52b2fa75-0e24-4d71-8164-2b56e5f5683c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "cinder-quobyte-52b2fa75-0e24-4d71-8164-2b56e5f5683c" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "cinder-quobyte-52b2fa75-0e24-4d71-8164-2b56e5f5683c" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:51:37 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.337s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:51:37 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Deleted volume successfully.
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea28dc-a1b0-4f9a-9e55-10b21739be21]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-1f6dc7ef-8177-447e-b4c3-327e06226e3a tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "cinder-24a3e2de-2fed-4f59-a5fb-7ed5e2932583-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:37 devstack sudo[101727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c
Sep 22 15:51:37 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:38 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c" returned: 0 in 0.475s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:38 devstack sudo[101733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c
Sep 22 15:51:38 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:38 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-52b2fa75-0e24-4d71-8164-2b56e5f5683c" returned: 0 in 0.274s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "cinder-quobyte-52b2fa75-0e24-4d71-8164-2b56e5f5683c" released by "delete_volume" :: held 0.801s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Created reservations ['ca7c9fc7-be5b-40aa-b60f-76c3be4d82a4', 'a1e671c0-eff3-4488-978a-4142198267bd', 'e2b085c7-cfab-4317-a898-a4582fc7cec1', '10d0dde3-55ba-4491-a5f2-73d282b522af'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:51:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:38 devstack sudo[101747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:51:38 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[94929354-4dde-4be1-97a2-9d5e98ac5166]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:39 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.548s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:51:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Deleted volume successfully.
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-425d4cf9-85d5-4e1f-b3cb-a81da5f0c7d3 tempest-TestServerVolumeAttachmentScenario-2051807396 None] Lock "cinder-52b2fa75-0e24-4d71-8164-2b56e5f5683c-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:51:39 devstack sudo[101756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff
Sep 22 15:51:39 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:39 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff" returned: 0 in 0.448s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbc42de-4a2a-48b0-ac70-2d61ae3da540]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:51:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:39 devstack sudo[101761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff
Sep 22 15:51:39 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:40 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff" returned: 0 in 0.430s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff /opt/stack/data/cinder/conversion/c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff.temp_image.385b1fd1-7ff9-4b75-9d6b-d97b82a6a45e_1f2ur1s.img {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:40 devstack sudo[101766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff /opt/stack/data/cinder/conversion/c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff.temp_image.385b1fd1-7ff9-4b75-9d6b-d97b82a6a45e_1f2ur1s.img
Sep 22 15:51:40 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:49 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=30,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=4 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:51:49 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=26,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:51:49 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff /opt/stack/data/cinder/conversion/c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff.temp_image.385b1fd1-7ff9-4b75-9d6b-d97b82a6a45e_1f2ur1s.img" returned: 0 in 9.924s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:50 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32185b1-0121-4905-91f3-e819420ca978]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:51:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:51:50 devstack sudo[101865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff
Sep 22 15:51:50 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:51:50 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root
Sep 22 15:51:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff" returned: 0 in 0.767s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:51:50 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff, size 1024.00 MB, duration 9.93 sec, destination /opt/stack/data/cinder/conversion/c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff.temp_image.385b1fd1-7ff9-4b75-9d6b-d97b82a6a45e_1f2ur1s.img {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:51:50 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Converted 1024.00 MB image at 103.17 MB/s
Sep 22 15:51:50 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] 385b1fd1-7ff9-4b75-9d6b-d97b82a6a45e was raw, no need to convert to raw {{(pid=85987) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 22 15:52:00 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:52:00 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Flow 'volume_create_manager' (07490ad8-543c-446d-8126-20683f402db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1743a869-097b-477e-b3b6-58be088c0d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1743a869-097b-477e-b3b6-58be088c0d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1630219999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2815e5c1-57dc-4484-ad8b-b893361b2a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b792b2fe7a47c497728cdf7fa01c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:11Z,use_quota=True,user_id='b5cb42d511c64c1b9ef15734517b3fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b40e78-7bc9-4a99-b239-a68b24eab6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b40e78-7bc9-4a99-b239-a68b24eab6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82040be-a21f-482f-b4ae-0da5f325e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82040be-a21f-482f-b4ae-0da5f325e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2815e5c1-57dc-4484-ad8b-b893361b2a60', 'volume_name': 'volume-2815e5c1-57dc-4484-ad8b-b893361b2a60', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0a91eb-4b87-423e-bd46-66fc119bb16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0a91eb-4b87-423e-bd46-66fc119bb16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfece42-2ba5-4a7c-960d-708a647e016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:11 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Volume 2815e5c1-57dc-4484-ad8b-b893361b2a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2815e5c1-57dc-4484-ad8b-b893361b2a60', 'volume_size': 1}
Sep 22 15:52:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.827s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Uploaded volume to glance image-id: 385b1fd1-7ff9-4b75-9d6b-d97b82a6a45e. {{(pid=85987) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.742s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1630219999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2815e5c1-57dc-4484-ad8b-b893361b2a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b792b2fe7a47c497728cdf7fa01c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:11Z,use_quota=True,user_id='b5cb42d511c64c1b9ef15734517b3fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Creating volume 2815e5c1-57dc-4484-ad8b-b893361b2a60 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:12 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:13 devstack sudo[101943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60 1073741824
Sep 22 15:52:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5b87df70-92a1-4a3c-a2e0-5b32bc96feef tempest-TestImageHashVerification-1585281664 None] Copy volume to image completed successfully.
Sep 22 15:52:13 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:13 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60 1073741824" returned: 0 in 0.487s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:13 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60
Sep 22 15:52:13 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:13 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60" returned: 0 in 0.295s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfece42-2ba5-4a7c-960d-708a647e016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2815e5c1-57dc-4484-ad8b-b893361b2a60', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5741f93b-7351-4652-9e33-a408860bdd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Volume volume-2815e5c1-57dc-4484-ad8b-b893361b2a60 (2815e5c1-57dc-4484-ad8b-b893361b2a60): created successfully
Sep 22 15:52:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5741f93b-7351-4652-9e33-a408860bdd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Flow 'volume_create_manager' (07490ad8-543c-446d-8126-20683f402db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ee6d869b-61a4-4ea6-ba6e-1abb1a607625 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Created volume successfully.
Sep 22 15:52:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Acquiring lock "cinder-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Lock "cinder-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Acquiring lock "cinder-quobyte-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Lock "cinder-quobyte-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:14 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66a7ad3-d781-4301-baca-fb0472522381]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:14 devstack sudo[101955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff
Sep 22 15:52:14 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-3a7dd64c-3285-40cd-8aa3-11083e3c535b req-6fdffdf7-97ac-40df-a4be-9b1b5f34c6d5 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-3a7dd64c-3285-40cd-8aa3-11083e3c535b req-6fdffdf7-97ac-40df-a4be-9b1b5f34c6d5 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-3a7dd64c-3285-40cd-8aa3-11083e3c535b req-6fdffdf7-97ac-40df-a4be-9b1b5f34c6d5 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-3a7dd64c-3285-40cd-8aa3-11083e3c535b req-6fdffdf7-97ac-40df-a4be-9b1b5f34c6d5 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-2815e5c1-57dc-4484-ad8b-b893361b2a60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac7adf63-f0ab-43da-8abf-97f56bdc569c', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:52:15 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff" returned: 0 in 0.465s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-3a7dd64c-3285-40cd-8aa3-11083e3c535b req-6fdffdf7-97ac-40df-a4be-9b1b5f34c6d5 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] attachment_update completed successfully.
Sep 22 15:52:15 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff
Sep 22 15:52:15 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:15 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff" returned: 0 in 0.358s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Lock "cinder-quobyte-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff" released by "delete_volume" :: held 0.898s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Created reservations ['c04e81de-a336-4e7d-aee6-9b6687c22288', '8a6cb7b4-1245-44b5-ac92-44708c71ba56', '77396761-8112-4e2a-82d3-ad4a2d475bcf', '0eab164c-96d7-4ecf-8418-6f76999bcb73'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:15 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:52:15 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:16 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.348s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:16 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:52:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Deleted volume successfully.
Sep 22 15:52:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73aa604b-2225-46e8-8988-4fab30846be1 tempest-TestImageHashVerification-1585281664 None] Lock "cinder-c0f278ed-0cd6-44a8-a93d-b5aa4a9bb5ff-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-e6ebd396-657b-49f9-a27c-85322dd74621 req-f9932fe1-eda9-4a48-a4f5-3c0938a513a4 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Terminate volume connection completed successfully.
Sep 22 15:52:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-e6ebd396-657b-49f9-a27c-85322dd74621 req-f9932fe1-eda9-4a48-a4f5-3c0938a513a4 tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Deleting attachment ac7adf63-f0ab-43da-8abf-97f56bdc569c. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:52:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Acquiring lock "cinder-2815e5c1-57dc-4484-ad8b-b893361b2a60-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "cinder-2815e5c1-57dc-4484-ad8b-b893361b2a60-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Acquiring lock "cinder-quobyte-2815e5c1-57dc-4484-ad8b-b893361b2a60" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "cinder-quobyte-2815e5c1-57dc-4484-ad8b-b893361b2a60" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:19 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb6d38-02eb-4447-94df-e67e094f7185]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:19 devstack sudo[102415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60
Sep 22 15:52:19 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:20 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60" returned: 0 in 0.499s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:20 devstack sudo[102421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60
Sep 22 15:52:20 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:20 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2815e5c1-57dc-4484-ad8b-b893361b2a60" returned: 0 in 0.271s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "cinder-quobyte-2815e5c1-57dc-4484-ad8b-b893361b2a60" released by "delete_volume" :: held 0.830s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Created reservations ['65090a3e-b955-4370-8e85-5ba36a85b102', '8e123982-720a-499e-9b8b-5d84d84b42c9', '77d4f975-1e33-4956-b8a7-d939bd81536b', 'd1018d8d-ff43-494f-a06e-377b59bd6913'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:20 devstack sudo[102425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:52:20 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:21 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.495s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:21 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:52:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Deleted volume successfully.
Sep 22 15:52:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d0b48bf2-8553-4aa5-b0fb-54ff5410569b tempest-TestServerVolumeAttachScenarioOldVersion-1712628906 None] Lock "cinder-2815e5c1-57dc-4484-ad8b-b893361b2a60-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:52:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:28 devstack sudo[102461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:52:28 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:29 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.347s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:52:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:52:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 29 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:52:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>, <Thread(Rabbit-heartbeat, started daemon 139419795786048)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:52:30 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=22,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=27,cinder:SELECT=18,cinder:DELETE=2,cinder:INSERT=4 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Flow 'volume_create_manager' (d2748629-f036-436a-ad40-d741827064d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec018929-cf0e-4a09-95ca-3c2ce71a9b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec018929-cf0e-4a09-95ca-3c2ce71a9b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-787126281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9643fd47-022a-45ff-bb16-45f488eada00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0399edd60e4c6dba5f634d02a7cb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:31Z,use_quota=True,user_id='14782b122cc64f7dbf3df451dda9b7f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ee3396-3d8b-4b24-b67a-3f80e4c0883c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ee3396-3d8b-4b24-b67a-3f80e4c0883c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd90b078-5833-4543-8a9b-f2351a261e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (efa95ba9-6fa3-4e11-953b-7e3a10dbb7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6390b259-501e-4ca5-8bf3-1bf97be15a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6390b259-501e-4ca5-8bf3-1bf97be15a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158926623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff6e973-a928-4fa5-b1a1-b787514f225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:31Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13121ac8-aba5-4c74-a59b-8df46e8dd8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13121ac8-aba5-4c74-a59b-8df46e8dd8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe3040f-ff26-4591-9540-da7604397e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe3040f-ff26-4591-9540-da7604397e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff6e973-a928-4fa5-b1a1-b787514f225b', 'volume_name': 'volume-4ff6e973-a928-4fa5-b1a1-b787514f225b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d2b001-317f-4789-b651-43d112d8e1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d2b001-317f-4789-b651-43d112d8e1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1d1a36-ca44-45e1-a5d1-2215c8c99ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume 4ff6e973-a928-4fa5-b1a1-b787514f225b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff6e973-a928-4fa5-b1a1-b787514f225b', 'volume_size': 1}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158926623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff6e973-a928-4fa5-b1a1-b787514f225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:31Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Creating volume 4ff6e973-a928-4fa5-b1a1-b787514f225b {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:31 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:31 devstack sudo[102465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b 1073741824
Sep 22 15:52:31 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd90b078-5833-4543-8a9b-f2351a261e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9643fd47-022a-45ff-bb16-45f488eada00', 'volume_name': 'volume-9643fd47-022a-45ff-bb16-45f488eada00', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd335fd310>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7718d203-e8a8-478f-88c9-c59c2da843c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7718d203-e8a8-478f-88c9-c59c2da843c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9c33a6-ada6-4f33-a054-4c04a966e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:31 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Volume 9643fd47-022a-45ff-bb16-45f488eada00: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9643fd47-022a-45ff-bb16-45f488eada00', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd335fd310>}
Sep 22 15:52:31 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Trying to clone 9643fd47-022a-45ff-bb16-45f488eada00 from image a1740871-5367-428b-bac9-1a5ec1bb8377 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:52:32 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b 1073741824" returned: 0 in 0.660s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:52:32 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Image download 20.69 MB at 20.69 MB/s
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:32 devstack sudo[102472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b
Sep 22 15:52:32 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[da71cab8-04cf-4362-8186-755860ff354a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:32 devstack sudo[102474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD
Sep 22 15:52:32 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:32 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b" returned: 0 in 0.283s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1d1a36-ca44-45e1-a5d1-2215c8c99ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff6e973-a928-4fa5-b1a1-b787514f225b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80ef3b6-2a96-4f05-833d-7ac0c49c18df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:32 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume volume-4ff6e973-a928-4fa5-b1a1-b787514f225b (4ff6e973-a928-4fa5-b1a1-b787514f225b): created successfully
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80ef3b6-2a96-4f05-833d-7ac0c49c18df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (efa95ba9-6fa3-4e11-953b-7e3a10dbb7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-cd7ce0e1-bcd5-468d-b07f-7ec02ed7d137 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created volume successfully.
Sep 22 15:52:32 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 is fetched for user 14782b122cc64f7dbf3df451dda9b7f9. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9872022-236b-420f-a936-d937406a1dc5]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:32 devstack sudo[102480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD
Sep 22 15:52:32 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:33 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-787126281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9643fd47-022a-45ff-bb16-45f488eada00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0399edd60e4c6dba5f634d02a7cb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:31Z,use_quota=True,user_id='14782b122cc64f7dbf3df451dda9b7f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Creating volume 9643fd47-022a-45ff-bb16-45f488eada00 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:33 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:33 devstack sudo[102485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 1073741824
Sep 22 15:52:33 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:33 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 1073741824" returned: 0 in 0.437s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:33 devstack sudo[102491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00
Sep 22 15:52:33 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:34 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00" returned: 0 in 0.252s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Attempting download of a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 9643fd47-022a-45ff-bb16-45f488eada00. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d35b6d-8bcf-48ec-a8f8-76e3a91ada71]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_6k9f5mje {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:34 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_6k9f5mje
Sep 22 15:52:34 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:34 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (a6a363c9-351e-423c-aee2-1e646d8ee493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e7375d-29ca-4e9b-8bc7-4af1d3abe9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_6k9f5mje" returned: 0 in 0.387s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_6k9f5mje {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e7375d-29ca-4e9b-8bc7-4af1d3abe9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1966999476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a30ebf6-9fe2-481f-afa5-07e3cf8c808f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:35Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1b70ad-c50d-435d-879c-741abff332c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1b70ad-c50d-435d-879c-741abff332c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da7bfad-29b4-4f5c-92c0-f4556e4e172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da7bfad-29b4-4f5c-92c0-f4556e4e172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a30ebf6-9fe2-481f-afa5-07e3cf8c808f', 'volume_name': 'volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b30d1c-5ecc-4d11-9481-a218115706cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b30d1c-5ecc-4d11-9481-a218115706cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2801fa8-4e11-4692-b1c4-a5fa1b96ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:34 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume 2a30ebf6-9fe2-481f-afa5-07e3cf8c808f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f', 'volume_size': 1}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1966999476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a30ebf6-9fe2-481f-afa5-07e3cf8c808f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:35Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Creating volume 2a30ebf6-9fe2-481f-afa5-07e3cf8c808f {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:34 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:34 devstack sudo[102499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f 1073741824
Sep 22 15:52:34 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:34 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_6k9f5mje
Sep 22 15:52:34 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:35 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_6k9f5mje" returned: 1 in 0.388s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1740871-5367-428b-bac9-1a5ec1bb8377_6k9f5mje' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bd586b-8c46-4d12-bfdc-05febf8aa3ec]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:35 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD
Sep 22 15:52:35 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:35 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f 1073741824" returned: 0 in 0.521s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:35 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] a1740871-5367-428b-bac9-1a5ec1bb8377 was qcow2, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:35 devstack sudo[102514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00
Sep 22 15:52:35 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:35 devstack sudo[102516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f
Sep 22 15:52:35 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (4e4afa7e-d31c-43a6-a7d6-17a1d9fc5e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ca547e-bfd7-4635-9847-d9c25493163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ca547e-bfd7-4635-9847-d9c25493163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1376954807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6b73bf-3c9d-4d24-8185-7cd86b5257f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:35Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81283472-5011-43b7-beab-7bc5dae40aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81283472-5011-43b7-beab-7bc5dae40aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7ea5e1-dbd3-412f-867a-e3e0698a0b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7ea5e1-dbd3-412f-867a-e3e0698a0b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6b73bf-3c9d-4d24-8185-7cd86b5257f0', 'volume_name': 'volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2248049-bc39-46ba-b661-f69e3729d042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2248049-bc39-46ba-b661-f69e3729d042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0115c2a0-6d93-43f4-a63b-00bdbc02e473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:35 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume 4e6b73bf-3c9d-4d24-8185-7cd86b5257f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0', 'volume_size': 1}
Sep 22 15:52:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:36 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f" returned: 0 in 0.343s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.209s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1376954807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6b73bf-3c9d-4d24-8185-7cd86b5257f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:35Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Creating volume 4e6b73bf-3c9d-4d24-8185-7cd86b5257f0 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:36 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2801fa8-4e11-4692-b1c4-a5fa1b96ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6454a2-ee98-469b-8c94-a6950f8cfbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:36 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0 1073741824
Sep 22 15:52:36 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f (2a30ebf6-9fe2-481f-afa5-07e3cf8c808f): created successfully
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6454a2-ee98-469b-8c94-a6950f8cfbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (a6a363c9-351e-423c-aee2-1e646d8ee493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5dc9503f-06e2-42d9-a571-23c8b99ecc98 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created volume successfully.
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (7fae44cf-95bd-49de-bd44-e93042f3bedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c4bd77-4c72-4475-a544-a039aa741122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c4bd77-4c72-4475-a544-a039aa741122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-941078128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c997da3-6087-4481-83fe-2f12e2e9949c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:36Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55d8420-bd17-425e-8d19-7c698cb8f622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55d8420-bd17-425e-8d19-7c698cb8f622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07530d69-cbab-40c9-bf7f-dd6ffce4d245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07530d69-cbab-40c9-bf7f-dd6ffce4d245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c997da3-6087-4481-83fe-2f12e2e9949c', 'volume_name': 'volume-1c997da3-6087-4481-83fe-2f12e2e9949c', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788985a0-8b87-4642-bcb8-8cd6d635df56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788985a0-8b87-4642-bcb8-8cd6d635df56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc424ee-5816-4f16-90b7-2ca4cbed0cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:36 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume 1c997da3-6087-4481-83fe-2f12e2e9949c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c997da3-6087-4481-83fe-2f12e2e9949c', 'volume_size': 1}
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:36 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0 1073741824" returned: 0 in 0.782s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:37 devstack sudo[102533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0
Sep 22 15:52:37 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:37 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0" returned: 0 in 0.320s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-941078128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c997da3-6087-4481-83fe-2f12e2e9949c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:36Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Creating volume 1c997da3-6087-4481-83fe-2f12e2e9949c {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:37 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0115c2a0-6d93-43f4-a63b-00bdbc02e473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacfb830-9eba-4d32-be8b-344708400e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:37 devstack sudo[102536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c 1073741824
Sep 22 15:52:37 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (af184536-b2f7-4fac-952e-515471284fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f9e746-e49f-4c2e-82d4-0f0667aded23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f9e746-e49f-4c2e-82d4-0f0667aded23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262729337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2715629-e5ee-4161-981a-7e7902f902ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:37Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d154f4ab-5d8e-4e68-8965-af3d83a4d8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d154f4ab-5d8e-4e68-8965-af3d83a4d8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a538499-5199-4eb7-baf9-ff17f6292f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a538499-5199-4eb7-baf9-ff17f6292f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2715629-e5ee-4161-981a-7e7902f902ef', 'volume_name': 'volume-f2715629-e5ee-4161-981a-7e7902f902ef', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3b8d6e-26e8-4b55-ba61-7b4550ef34e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3b8d6e-26e8-4b55-ba61-7b4550ef34e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef92bc12-695a-4da0-8924-e1e4dc16581e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:37 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume f2715629-e5ee-4161-981a-7e7902f902ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2715629-e5ee-4161-981a-7e7902f902ef', 'volume_size': 1}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:37 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0 (4e6b73bf-3c9d-4d24-8185-7cd86b5257f0): created successfully
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacfb830-9eba-4d32-be8b-344708400e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (4e4afa7e-d31c-43a6-a7d6-17a1d9fc5e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:37 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00" returned: 0 in 2.430s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1740871-5367-428b-bac9-1a5ec1bb8377_l1jzsh__devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:52:37 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Converted 112.00 MB image at 46.08 MB/s
Sep 22 15:52:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:38 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c 1073741824" returned: 0 in 0.574s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:38 devstack sudo[102544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 1G
Sep 22 15:52:38 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d9f77b01-75df-409d-98a0-baa1936e5bf3 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created volume successfully.
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:38 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 1G" returned: 0 in 0.364s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Downloaded image a1740871-5367-428b-bac9-1a5ec1bb8377 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}])) to volume 9643fd47-022a-45ff-bb16-45f488eada00 successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:52:38 devstack sudo[102550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c
Sep 22 15:52:38 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Temporary image a1740871-5367-428b-bac9-1a5ec1bb8377 for user 14782b122cc64f7dbf3df451dda9b7f9 is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Marking volume 9643fd47-022a-45ff-bb16-45f488eada00 as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Copying metadata from image a1740871-5367-428b-bac9-1a5ec1bb8377 to 9643fd47-022a-45ff-bb16-45f488eada00. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Creating volume glance metadata for volume 9643fd47-022a-45ff-bb16-45f488eada00 backed by image a1740871-5367-428b-bac9-1a5ec1bb8377 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:52:38 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c" returned: 0 in 0.281s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262729337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2715629-e5ee-4161-981a-7e7902f902ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:37Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Creating volume f2715629-e5ee-4161-981a-7e7902f902ef {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:38 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc424ee-5816-4f16-90b7-2ca4cbed0cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c997da3-6087-4481-83fe-2f12e2e9949c', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:38 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef 1073741824
Sep 22 15:52:38 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b776e67c-5b36-4c41-8bce-e477e3466cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume volume-1c997da3-6087-4481-83fe-2f12e2e9949c (1c997da3-6087-4481-83fe-2f12e2e9949c): created successfully
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b776e67c-5b36-4c41-8bce-e477e3466cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (7fae44cf-95bd-49de-bd44-e93042f3bedf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9c33a6-ada6-4f33-a054-4c04a966e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9643fd47-022a-45ff-bb16-45f488eada00', 'volume_size': 1, 'image_id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1740871-5367-428b-bac9-1a5ec1bb8377', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '516cd2fdaa894acca611edcd8de23425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1740871-5367-428b-bac9-1a5ec1bb8377', 'created_at': datetime.datetime(2026, 9, 22, 13, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1740871-5367-428b-bac9-1a5ec1bb8377/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd335fd310>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2484fc-f0c5-41dd-99b7-eeaffafbdf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4b07e16f-3a54-433a-a63e-409855b5c26b tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created volume successfully.
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (c2b6f207-05c0-4db2-941f-a4e3dd746ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5963185f-75c4-485b-973e-1e7778695fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Volume volume-9643fd47-022a-45ff-bb16-45f488eada00 (9643fd47-022a-45ff-bb16-45f488eada00): created successfully
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2484fc-f0c5-41dd-99b7-eeaffafbdf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Flow 'volume_create_manager' (d2748629-f036-436a-ad40-d741827064d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5963185f-75c4-485b-973e-1e7778695fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1935671400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb27c3c5-6951-49a7-ba86-a73efd4c7fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:39Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ad3da8-f9cb-455f-aef6-c67dfaf1c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ad3da8-f9cb-455f-aef6-c67dfaf1c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a9ed77-4253-4928-ae5e-667f1cfdca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a9ed77-4253-4928-ae5e-667f1cfdca3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb27c3c5-6951-49a7-ba86-a73efd4c7fd5', 'volume_name': 'volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c81d0b2-7b34-4196-922f-74bbfb57ae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c81d0b2-7b34-4196-922f-74bbfb57ae2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541c9877-a1e9-468a-b9c3-26cc12946c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:39 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume fb27c3c5-6951-49a7-ba86-a73efd4c7fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5', 'volume_size': 1}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f4298570-f3f3-4dd4-9f16-fc0b08790115 tempest-TestShelveInstance-1497123023 None] Created volume successfully.
Sep 22 15:52:39 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef 1073741824" returned: 0 in 0.540s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:39 devstack sudo[102559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef
Sep 22 15:52:39 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:39 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef" returned: 0 in 0.267s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1935671400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb27c3c5-6951-49a7-ba86-a73efd4c7fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250beb49259043c5aa2ceeeaf8a8d00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:39Z,use_quota=True,user_id='a60a1ea2f1d44ef3af5b8dfafbed6d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Creating volume fb27c3c5-6951-49a7-ba86-a73efd4c7fd5 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:39 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:39 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5 1073741824
Sep 22 15:52:39 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef92bc12-695a-4da0-8924-e1e4dc16581e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2715629-e5ee-4161-981a-7e7902f902ef', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d5eaa6-4885-4184-b41f-da605fb382e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:39 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume volume-f2715629-e5ee-4161-981a-7e7902f902ef (f2715629-e5ee-4161-981a-7e7902f902ef): created successfully
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d5eaa6-4885-4184-b41f-da605fb382e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (af184536-b2f7-4fac-952e-515471284fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-60b621ec-c77d-482c-8907-387a7155fafa tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created volume successfully.
Sep 22 15:52:40 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5 1073741824" returned: 0 in 0.571s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:40 devstack sudo[102569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5
Sep 22 15:52:40 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:40 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5" returned: 0 in 0.261s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541c9877-a1e9-468a-b9c3-26cc12946c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf15e11-ee32-4c05-b680-f69f911b3534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:40 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Volume volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5 (fb27c3c5-6951-49a7-ba86-a73efd4c7fd5): created successfully
Sep 22 15:52:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf15e11-ee32-4c05-b680-f69f911b3534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Flow 'volume_create_manager' (c2b6f207-05c0-4db2-941f-a4e3dd746ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0a67e64c-938a-4205-b8fd-c478c258223a tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created volume successfully.
Sep 22 15:52:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-quobyte-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:41 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd97a6c-1eaf-4a5c-b5dc-5715053d79e4]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:41 devstack sudo[102576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5
Sep 22 15:52:41 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:41 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5" returned: 0 in 0.507s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:41 devstack sudo[102581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5
Sep 22 15:52:41 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:41 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5" returned: 0 in 0.320s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5" released by "delete_volume" :: held 0.882s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created reservations ['2f244f89-6320-42f2-ac5b-4fe213650d63', 'fd792a50-8bc4-4e2c-a35d-be7bbb6fecf4', 'ce35e841-bba5-46f1-987d-454fb756641b', '5240481a-d996-43b5-8b0b-87a75ab585cb'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-f2715629-e5ee-4161-981a-7e7902f902ef-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:42 devstack sudo[102584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:52:42 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-f2715629-e5ee-4161-981a-7e7902f902ef-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-quobyte-f2715629-e5ee-4161-981a-7e7902f902ef" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-f2715629-e5ee-4161-981a-7e7902f902ef" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7dbaff-5466-49f9-aa9f-700dfd367612]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:42 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.401s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:52:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Deleted volume successfully.
Sep 22 15:52:42 devstack sudo[102586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef
Sep 22 15:52:42 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-80be0d57-dba3-4531-94d0-1ab54b098ee8 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-fb27c3c5-6951-49a7-ba86-a73efd4c7fd5-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-7454b2bb-e785-4d87-b89a-f8b7fecce68f req-a96bd3f1-9345-46cc-bf7f-1cb349464893 tempest-TestShelveInstance-1497123023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-7454b2bb-e785-4d87-b89a-f8b7fecce68f req-a96bd3f1-9345-46cc-bf7f-1cb349464893 tempest-TestShelveInstance-1497123023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-7454b2bb-e785-4d87-b89a-f8b7fecce68f req-a96bd3f1-9345-46cc-bf7f-1cb349464893 tempest-TestShelveInstance-1497123023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-7454b2bb-e785-4d87-b89a-f8b7fecce68f req-a96bd3f1-9345-46cc-bf7f-1cb349464893 tempest-TestShelveInstance-1497123023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-9643fd47-022a-45ff-bb16-45f488eada00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4794743-5a11-4a95-8bec-c8526b9e11f9', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:52:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-7454b2bb-e785-4d87-b89a-f8b7fecce68f req-a96bd3f1-9345-46cc-bf7f-1cb349464893 tempest-TestShelveInstance-1497123023 None] attachment_update completed successfully.
Sep 22 15:52:43 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef" returned: 0 in 0.619s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:43 devstack sudo[102601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef
Sep 22 15:52:43 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:43 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f2715629-e5ee-4161-981a-7e7902f902ef" returned: 0 in 0.318s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-f2715629-e5ee-4161-981a-7e7902f902ef" released by "delete_volume" :: held 1.043s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created reservations ['0b44632b-3cf4-49be-8e28-7f6294a5315b', 'e4921d0a-0aa8-46a5-ba04-da2586b6dd73', 'f484b547-54b6-469f-9e74-a95c1afb94a1', '5186077f-aa1f-4621-89dd-034e5f9b2629'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:43 devstack sudo[102604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:52:43 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:43 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.279s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:43 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:52:44 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Deleted volume successfully.
Sep 22 15:52:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3d30dec0-184e-492e-9c44-c12649743983 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-f2715629-e5ee-4161-981a-7e7902f902ef-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-1c997da3-6087-4481-83fe-2f12e2e9949c-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-1c997da3-6087-4481-83fe-2f12e2e9949c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-quobyte-1c997da3-6087-4481-83fe-2f12e2e9949c" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-1c997da3-6087-4481-83fe-2f12e2e9949c" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d15cc8-12c4-4d53-8c96-f1bd90c72343]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:44 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c
Sep 22 15:52:44 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:45 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c" returned: 0 in 0.566s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:45 devstack sudo[102613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c
Sep 22 15:52:45 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:45 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1c997da3-6087-4481-83fe-2f12e2e9949c" returned: 0 in 0.275s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-1c997da3-6087-4481-83fe-2f12e2e9949c" released by "delete_volume" :: held 0.901s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created reservations ['6c39be55-58c9-4c4a-b799-7ea694c56ed5', '4c1fabd1-a1fc-40e8-bc07-aa50ec09682e', 'c8660bdf-30e2-43c7-861b-efff8af1477f', '10f3329d-313a-4e9d-bada-108eaa85400f'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:45 devstack sudo[102616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:52:45 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:46 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.403s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:46 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:52:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Deleted volume successfully.
Sep 22 15:52:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-02361053-8999-4fcc-a958-59b1f0ed2e54 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-1c997da3-6087-4481-83fe-2f12e2e9949c-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-quobyte-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:47 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1000be-6c63-458c-9102-f1e3e67d63d6]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:47 devstack sudo[103079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0
Sep 22 15:52:47 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:47 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0" returned: 0 in 0.641s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:47 devstack sudo[103100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0
Sep 22 15:52:47 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:48 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0" returned: 0 in 0.389s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0" released by "delete_volume" :: held 1.108s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created reservations ['8010964c-384f-4e94-8d18-3faa2ebd71a2', '679ae055-9e23-4fb7-a38e-d89f74e35102', 'cb4acf5f-d058-4908-ab21-5d90504ca7ee', '395b2171-a691-4b97-81e2-55739ad2b3ee'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:48 devstack sudo[103103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:52:48 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:48 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.386s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:52:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Deleted volume successfully.
Sep 22 15:52:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-dbb75a3e-f184-49a0-afa7-5000f3ec482d tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-4e6b73bf-3c9d-4d24-8185-7cd86b5257f0-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-quobyte-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f" acquired by "delete_volume" :: waited 0.044s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:49 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbcc3f5-5ea0-4f89-bfe1-b19314789d57]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:49 devstack sudo[103108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f
Sep 22 15:52:49 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:49 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f" returned: 0 in 0.486s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:50 devstack sudo[103113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f
Sep 22 15:52:50 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:50 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f" returned: 0 in 0.398s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f" released by "delete_volume" :: held 0.952s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:50 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created reservations ['9be16cef-5a77-4faa-86b9-4a4769e80d2b', '7c048b47-51ab-4f23-b922-22ec9e7b84bd', 'f9e337bb-e030-43af-b91a-6a4d7f050965', '1cbe01cd-287e-4a32-97a4-27b2846246ad'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:52:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:50 devstack sudo[103117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:52:50 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:51 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.395s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:51 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:52:51 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Deleted volume successfully.
Sep 22 15:52:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a91e82ce-51de-43b7-b388-287d15d573bb tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-2a30ebf6-9fe2-481f-afa5-07e3cf8c808f-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-4ff6e973-a928-4fa5-b1a1-b787514f225b-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-4ff6e973-a928-4fa5-b1a1-b787514f225b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "cinder-quobyte-4ff6e973-a928-4fa5-b1a1-b787514f225b" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-4ff6e973-a928-4fa5-b1a1-b787514f225b" acquired by "delete_volume" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fe152c-e7c7-4498-8d01-07639f6a8e66]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:52 devstack sudo[103120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b
Sep 22 15:52:52 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:52 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b" returned: 0 in 0.475s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:52 devstack sudo[103125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b
Sep 22 15:52:52 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:52 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4ff6e973-a928-4fa5-b1a1-b787514f225b" returned: 0 in 0.545s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-quobyte-4ff6e973-a928-4fa5-b1a1-b787514f225b" released by "delete_volume" :: held 1.106s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Flow 'volume_create_manager' (b7b5172a-ba85-4c26-b42d-c601869cfde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9bb49e-c8ad-4b24-a91a-bea855bbbc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9bb49e-c8ad-4b24-a91a-bea855bbbc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1ffd7b-af71-4f25-9b28-fe8f81c132b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a8624ffaa74c18b2fc113d5be8374f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:53Z,use_quota=True,user_id='de27a4700adb4f109aae7143fdf5ab26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93470092-788b-4a4d-95d4-161507afc185),volume_type_id=93470092-788b-4a4d-95d4-161507afc185)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b97823a-d938-4fd0-88f1-e8f35aadfb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b97823a-d938-4fd0-88f1-e8f35aadfb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f9949d-847b-4a3a-b8a5-e2e6f1d5efb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Created reservations ['edd235f0-7bf0-41ca-b5d4-4a3399ae1df0', 'ab5a7020-4ad0-4e99-bcba-f5676635ef7d', 'f5dc7ec9-3c2d-419b-a2dc-dc635dd8a2e0', '07e29a47-dc51-4acc-bb98-3674fa410267'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:53 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:52:53 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f9949d-847b-4a3a-b8a5-e2e6f1d5efb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f1ffd7b-af71-4f25-9b28-fe8f81c132b2', 'volume_name': 'volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2', 'volume_size': 1, 'image_id': '29d250d8-af8b-4c69-bc28-0791506dd9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29d250d8-af8b-4c69-bc28-0791506dd9fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a95251ec77b5263d2bfbd3a47d1224a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0a8624ffaa74c18b2fc113d5be8374f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '923042d34a4b5bf772819ad72cb5f3e58f7049bfaab39381b9ffb254417ea29f4404ef6a5d183659506e4af58c50001f1b677c742539ba1428bd81d960b7dc4d', 'id': '29d250d8-af8b-4c69-bc28-0791506dd9fd', 'created_at': datetime.datetime(2026, 9, 22, 13, 52, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 52, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29d250d8-af8b-4c69-bc28-0791506dd9fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd292a81d0>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad490c1-72fa-4429-83c7-29f76edbf27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad490c1-72fa-4429-83c7-29f76edbf27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62ac48d-965b-431e-8c43-4e04eb5df2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:53 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Volume 0f1ffd7b-af71-4f25-9b28-fe8f81c132b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2', 'volume_size': 1, 'image_id': '29d250d8-af8b-4c69-bc28-0791506dd9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29d250d8-af8b-4c69-bc28-0791506dd9fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a95251ec77b5263d2bfbd3a47d1224a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0a8624ffaa74c18b2fc113d5be8374f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '923042d34a4b5bf772819ad72cb5f3e58f7049bfaab39381b9ffb254417ea29f4404ef6a5d183659506e4af58c50001f1b677c742539ba1428bd81d960b7dc4d', 'id': '29d250d8-af8b-4c69-bc28-0791506dd9fd', 'created_at': datetime.datetime(2026, 9, 22, 13, 52, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 52, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29d250d8-af8b-4c69-bc28-0791506dd9fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd292a81d0>}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Trying to clone 0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 from image 29d250d8-af8b-4c69-bc28-0791506dd9fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/29d250d8-af8b-4c69-bc28-0791506dd9fd', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:52:53 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.373s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:52:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Deleted volume successfully.
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:52:53 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Image download 0.00 MB at 0.00 MB/s
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-16f81d9b-ac48-4573-95ad-35e5aa96a789 tempest-CreateVolumesFromSourceVolumeTest-222580322 None] Lock "cinder-4ff6e973-a928-4fa5-b1a1-b787514f225b-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[503bc1d1-1529-44bc-83f8-387cb5fd369a]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:53 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD
Sep 22 15:52:53 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:54 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:54 devstack sudo[103137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD
Sep 22 15:52:54 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:54 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:52:54 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Temporary image 29d250d8-af8b-4c69-bc28-0791506dd9fd is fetched for user de27a4700adb4f109aae7143fdf5ab26. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:52:54 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b9d2b-4751-413f-838f-e2c32a0a454b]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:54 devstack sudo[103142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD
Sep 22 15:52:54 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:55 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:55 devstack sudo[103146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD
Sep 22 15:52:55 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:55 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1ffd7b-af71-4f25-9b28-fe8f81c132b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a8624ffaa74c18b2fc113d5be8374f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:53Z,use_quota=True,user_id='de27a4700adb4f109aae7143fdf5ab26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93470092-788b-4a4d-95d4-161507afc185),volume_type_id=93470092-788b-4a4d-95d4-161507afc185)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Creating volume 0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:55 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:55 devstack sudo[103151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 1073741824
Sep 22 15:52:55 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:55 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 1073741824" returned: 0 in 0.479s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:55 devstack sudo[103157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2
Sep 22 15:52:55 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:56 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:56 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Attempting download of 29d250d8-af8b-4c69-bc28-0791506dd9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/29d250d8-af8b-4c69-bc28-0791506dd9fd', 'metadata': {}}])) to volume 0f1ffd7b-af71-4f25-9b28-fe8f81c132b2. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:52:56 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[959a520e-bbb9-4446-9025-ddf1e150ec9d]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29d250d8-af8b-4c69-bc28-0791506dd9fd_07vx4byb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:56 devstack sudo[103160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29d250d8-af8b-4c69-bc28-0791506dd9fd_07vx4byb
Sep 22 15:52:56 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:56 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29d250d8-af8b-4c69-bc28-0791506dd9fd_07vx4byb" returned: 0 in 0.356s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29d250d8-af8b-4c69-bc28-0791506dd9fd_07vx4byb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:56 devstack sudo[103164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29d250d8-af8b-4c69-bc28-0791506dd9fd_07vx4byb
Sep 22 15:52:56 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:57 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29d250d8-af8b-4c69-bc28-0791506dd9fd_07vx4byb" returned: 1 in 0.371s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29d250d8-af8b-4c69-bc28-0791506dd9fd_07vx4byb' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fbf199-8cef-4147-8b3b-028793d6e840]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:57 devstack sudo[103168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD
Sep 22 15:52:57 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Flow 'volume_create_manager' (fc15aef4-ab9d-42f2-89d3-8d1dceb40478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661d4cd9-7458-4d7a-aa6d-22ce236aba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661d4cd9-7458-4d7a-aa6d-22ce236aba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-871297645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1dae4e2-f8d3-46e6-9256-39f1a584610f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2131d81b0c684a2dac7405715dc7abcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:57Z,use_quota=True,user_id='a87d8cb5ee2640e289774f45829b875f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdfd722-001d-4862-8086-7b6a53ed401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdfd722-001d-4862-8086-7b6a53ed401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b3da5c-6e69-4c6f-a45e-d79e8f8160d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b3da5c-6e69-4c6f-a45e-d79e8f8160d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1dae4e2-f8d3-46e6-9256-39f1a584610f', 'volume_name': 'volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b545f02-c792-4d94-8202-0073e206c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b545f02-c792-4d94-8202-0073e206c679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d64e98-4143-4f09-b9e2-a5c6a55c4b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:57 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Volume c1dae4e2-f8d3-46e6-9256-39f1a584610f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f', 'volume_size': 1}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-871297645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1dae4e2-f8d3-46e6-9256-39f1a584610f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2131d81b0c684a2dac7405715dc7abcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:52:57Z,use_quota=True,user_id='a87d8cb5ee2640e289774f45829b875f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Creating volume c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:52:57 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:57 devstack sudo[103170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f 1073741824
Sep 22 15:52:57 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:57 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:57 devstack sudo[103174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD
Sep 22 15:52:57 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:57 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f 1073741824" returned: 0 in 0.429s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:57 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] 29d250d8-af8b-4c69-bc28-0791506dd9fd was raw, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:57 devstack sudo[103182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2
Sep 22 15:52:57 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:57 devstack sudo[103183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f
Sep 22 15:52:57 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:58 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f" returned: 0 in 0.289s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d64e98-4143-4f09-b9e2-a5c6a55c4b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a00590a-89d9-4769-97ef-c0c24a4966fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:58 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Volume volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f (c1dae4e2-f8d3-46e6-9256-39f1a584610f): created successfully
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a00590a-89d9-4769-97ef-c0c24a4966fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Flow 'volume_create_manager' (fc15aef4-ab9d-42f2-89d3-8d1dceb40478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b2021c20-ad36-4de4-b1c7-22d6c0ac58ee tempest-VolumeDependencyTests-1796431380 None] Created volume successfully.
Sep 22 15:52:58 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2" returned: 0 in 0.530s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29d250d8-af8b-4c69-bc28-0791506dd9fd_8wjg77acdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:52:58 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Converted 0.00 MB image at 0.00 MB/s
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:58 devstack sudo[103191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 1G
Sep 22 15:52:58 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:58 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 1G" returned: 0 in 0.320s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Downloaded image 29d250d8-af8b-4c69-bc28-0791506dd9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/29d250d8-af8b-4c69-bc28-0791506dd9fd', 'metadata': {}}])) to volume 0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Temporary image 29d250d8-af8b-4c69-bc28-0791506dd9fd for user de27a4700adb4f109aae7143fdf5ab26 is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Marking volume 0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Copying metadata from image 29d250d8-af8b-4c69-bc28-0791506dd9fd to 0f1ffd7b-af71-4f25-9b28-fe8f81c132b2. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Creating volume glance metadata for volume 0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 backed by image 29d250d8-af8b-4c69-bc28-0791506dd9fd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '29d250d8-af8b-4c69-bc28-0791506dd9fd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8a95251ec77b5263d2bfbd3a47d1224a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62ac48d-965b-431e-8c43-4e04eb5df2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2', 'volume_size': 1, 'image_id': '29d250d8-af8b-4c69-bc28-0791506dd9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29d250d8-af8b-4c69-bc28-0791506dd9fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a95251ec77b5263d2bfbd3a47d1224a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0a8624ffaa74c18b2fc113d5be8374f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '923042d34a4b5bf772819ad72cb5f3e58f7049bfaab39381b9ffb254417ea29f4404ef6a5d183659506e4af58c50001f1b677c742539ba1428bd81d960b7dc4d', 'id': '29d250d8-af8b-4c69-bc28-0791506dd9fd', 'created_at': datetime.datetime(2026, 9, 22, 13, 52, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 52, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29d250d8-af8b-4c69-bc28-0791506dd9fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd292a81d0>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1773af-bbdf-4387-924b-f8bfa6018a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:52:58 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Volume volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 (0f1ffd7b-af71-4f25-9b28-fe8f81c132b2): created successfully
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1773af-bbdf-4387-924b-f8bfa6018a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:52:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Flow 'volume_create_manager' (b7b5172a-ba85-4c26-b42d-c601869cfde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:52:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a89aacdc-f030-4701-a5a9-25cdaa4f0c87 tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Created volume successfully.
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Acquiring lock "cinder-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "cinder-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Acquiring lock "cinder-quobyte-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "cinder-quobyte-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d036f7-2eb6-4f0f-9e09-c9eade82ce93]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Creating offline snapshot 93c34022-6f2f-4515-9d5e-9139ab09cd38 of volume c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f01ac3-d4ae-4c55-83eb-580a39585488]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:59 devstack sudo[103196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2
Sep 22 15:52:59 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:59 devstack sudo[103197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f
Sep 22 15:52:59 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:59 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2" returned: 0 in 0.388s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:52:59 devstack sudo[103203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2
Sep 22 15:52:59 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:52:59 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f" returned: 0 in 0.424s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:52:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:00 devstack sudo[103208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 1G
Sep 22 15:53:00 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:00 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2" returned: 0 in 0.266s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "cinder-quobyte-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2" released by "delete_volume" :: held 0.721s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:00 devstack cinder-volume[85987]: WARNING cinder.quota [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:53:00 devstack cinder-volume[85987]: WARNING cinder.quota [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Created reservations ['0f3cb391-ee46-4d60-8bc1-63749c23ba81', 'b18021c6-667c-4c91-b8cc-ab7d0dfaf410', 'fb6e3877-40d5-4b0b-8bba-140b7bea9958', '405de627-021c-4dfa-8ed6-15d923346f00'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:00 devstack sudo[103215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:53:00 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:00 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 1G" returned: 0 in 0.464s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:00 devstack sudo[103218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38
Sep 22 15:53:00 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:00 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:53:00 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Deleted volume successfully.
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2435a663-1b63-4a54-975d-0c41732b508e tempest-VolumeAndVolumeTypeFromImageTest-286805879 None] Lock "cinder-0f1ffd7b-af71-4f25-9b28-fe8f81c132b2-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:00 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38" returned: 0 in 0.364s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:00 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 is being set with open permissions: ugo+rw
Sep 22 15:53:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:00 devstack sudo[103224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38
Sep 22 15:53:00 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:01 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38" returned: 0 in 0.292s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:01 devstack sudo[103227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.info
Sep 22 15:53:01 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:01 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.info" returned: 0 in 0.266s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:01 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.info is being set with open permissions: ugo+rw
Sep 22 15:53:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:01 devstack sudo[103230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.info
Sep 22 15:53:01 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:01 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.info" returned: 0 in 0.270s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:01 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-51dc1ebf-32ef-43fb-b808-6b392ffddd55 tempest-VolumeDependencyTests-1796431380 None] Create snapshot completed successfully
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Flow 'volume_create_manager' (44e66556-e9e4-487e-844f-82da7c64f45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65b0363-61a0-49af-9c19-b0df8f5b41d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65b0363-61a0-49af-9c19-b0df8f5b41d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-423416325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0fc213-4545-47ca-bdd5-2591066af743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2131d81b0c684a2dac7405715dc7abcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93c34022-6f2f-4515-9d5e-9139ab09cd38,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:03Z,use_quota=True,user_id='a87d8cb5ee2640e289774f45829b875f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd26a8c9-fb5f-4529-8292-72f9c28be973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd26a8c9-fb5f-4529-8292-72f9c28be973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01dc031-6d17-406c-8069-db87a137861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01dc031-6d17-406c-8069-db87a137861d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af0fc213-4545-47ca-bdd5-2591066af743', 'volume_name': 'volume-af0fc213-4545-47ca-bdd5-2591066af743', 'volume_size': 1, 'snapshot_id': '93c34022-6f2f-4515-9d5e-9139ab09cd38'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a994d4-60a1-49c3-95d0-54fecf67bc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a994d4-60a1-49c3-95d0-54fecf67bc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bdec55-39a2-4f9b-8097-e3d7350a5edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:03 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Volume af0fc213-4545-47ca-bdd5-2591066af743: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af0fc213-4545-47ca-bdd5-2591066af743', 'volume_size': 1, 'snapshot_id': '93c34022-6f2f-4515-9d5e-9139ab09cd38'}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "cinder-quobyte-93c34022-6f2f-4515-9d5e-9139ab09cd38-af0fc213-4545-47ca-bdd5-2591066af743" by "_create_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-93c34022-6f2f-4515-9d5e-9139ab09cd38-af0fc213-4545-47ca-bdd5-2591066af743" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Creating volume af0fc213-4545-47ca-bdd5-2591066af743 from snapshot 93c34022-6f2f-4515-9d5e-9139ab09cd38 {{(pid=85987) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "cinder-quobyte-af0fc213-4545-47ca-bdd5-2591066af743" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-af0fc213-4545-47ca-bdd5-2591066af743" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] snapshot: 93c34022-6f2f-4515-9d5e-9139ab09cd38, volume: af0fc213-4545-47ca-bdd5-2591066af743,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff22cd7-2264-4922-84ad-bb2ebc1ea245]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:03 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38
Sep 22 15:53:03 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:04 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38" returned: 0 in 0.455s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:53:04 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa931dd7-dd21-4703-915f-08654853d749]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:04 devstack sudo[103240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f
Sep 22 15:53:04 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:04 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f" returned: 0 in 0.416s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:53:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:53:04 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743 not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:53:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:04 devstack sudo[103249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743
Sep 22 15:53:04 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:10 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743" returned: 0 in 6.227s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:10 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:53:10 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Converted 1024.00 MB image at 164.41 MB/s
Sep 22 15:53:10 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743 is being set with open permissions: ugo+rw
Sep 22 15:53:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:10 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743
Sep 22 15:53:10 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:11 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743" returned: 0 in 0.241s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-af0fc213-4545-47ca-bdd5-2591066af743" released by "_copy_volume_from_snapshot" :: held 7.463s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:11 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-93c34022-6f2f-4515-9d5e-9139ab09cd38-af0fc213-4545-47ca-bdd5-2591066af743" released by "_create_volume_from_snapshot" :: held 7.533s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.552s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bdec55-39a2-4f9b-8097-e3d7350a5edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0fc213-4545-47ca-bdd5-2591066af743', 'volume_size': 1, 'snapshot_id': '93c34022-6f2f-4515-9d5e-9139ab09cd38'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb28236d-7d43-4fbc-b5e9-fe41fdcc1519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:11 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Volume volume-af0fc213-4545-47ca-bdd5-2591066af743 (af0fc213-4545-47ca-bdd5-2591066af743): created successfully
Sep 22 15:53:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb28236d-7d43-4fbc-b5e9-fe41fdcc1519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Flow 'volume_create_manager' (44e66556-e9e4-487e-844f-82da7c64f45a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:53:11 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b2e1f237-3939-40b3-ac87-adb668e74681 tempest-VolumeDependencyTests-1796431380 None] Created volume successfully.
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "cinder-93c34022-6f2f-4515-9d5e-9139ab09cd38-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-93c34022-6f2f-4515-9d5e-9139ab09cd38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "cinder-quobyte-c1dae4e2-f8d3-46e6-9256-39f1a584610f" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-c1dae4e2-f8d3-46e6-9256-39f1a584610f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "cinder-quobyte-93c34022-6f2f-4515-9d5e-9139ab09cd38" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-93c34022-6f2f-4515-9d5e-9139ab09cd38" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Deleting offline snapshot 93c34022-6f2f-4515-9d5e-9139ab09cd38 of volume c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] snapshot_file for this snap is: volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1722d96f-40c7-46d7-9c39-2a6eae74bed8]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:12 devstack sudo[103336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38
Sep 22 15:53:12 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:12 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38" returned: 0 in 0.385s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[50050e63-70be-44a3-a2ee-3cd37fe0ad54]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:12 devstack sudo[103341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f
Sep 22 15:53:12 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:13 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f" returned: 0 in 0.573s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:13 devstack sudo[103346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38
Sep 22 15:53:13 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:13 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38" returned: 0 in 0.357s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:13 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38
Sep 22 15:53:13 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:13 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f.93c34022-6f2f-4515-9d5e-9139ab09cd38" returned: 0 in 0.251s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-93c34022-6f2f-4515-9d5e-9139ab09cd38" released by "_delete_snapshot" :: held 1.668s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-c1dae4e2-f8d3-46e6-9256-39f1a584610f" released by "delete_snapshot" :: held 1.693s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:13 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Created reservations ['30fd0601-610a-494b-bc62-0249fba627c8', '348a29c6-97a0-4654-aeb0-2f03de426c29', 'e4b569d9-ab24-445b-bfca-628098c136cc', '2b21ea21-54b9-4a0d-a223-5035276880b1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:53:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Delete snapshot completed successfully.
Sep 22 15:53:13 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-db421d8b-9a88-478a-97dd-aaed31b90952 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-93c34022-6f2f-4515-9d5e-9139ab09cd38-delete_snapshot" released by "delete_snapshot" :: held 1.838s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "cinder-c1dae4e2-f8d3-46e6-9256-39f1a584610f-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-c1dae4e2-f8d3-46e6-9256-39f1a584610f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "cinder-quobyte-c1dae4e2-f8d3-46e6-9256-39f1a584610f" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-c1dae4e2-f8d3-46e6-9256-39f1a584610f" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3c9dfe-901a-49dd-959d-7e2518eeb0c8]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:14 devstack sudo[103360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f
Sep 22 15:53:14 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:14 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f" returned: 0 in 0.358s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:14 devstack sudo[103365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f
Sep 22 15:53:14 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:14 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c1dae4e2-f8d3-46e6-9256-39f1a584610f" returned: 0 in 0.247s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:14 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-c1dae4e2-f8d3-46e6-9256-39f1a584610f" released by "delete_volume" :: held 0.671s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Created reservations ['a89e7eb9-2ddc-46ec-b533-1fd3be9d75a4', '64dead02-3343-40e3-b26c-590bcb8dea32', '6097d85b-db23-4ca9-95e5-cc78f035d316', 'a7e60109-1bc2-4a18-8738-a062ae66f88e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:15 devstack sudo[103368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:53:15 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:15 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.245s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:53:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Deleted volume successfully.
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-14a0dfc0-e478-4dc3-b6e6-244bbc8567ab tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-c1dae4e2-f8d3-46e6-9256-39f1a584610f-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "cinder-af0fc213-4545-47ca-bdd5-2591066af743-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-af0fc213-4545-47ca-bdd5-2591066af743-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "cinder-quobyte-af0fc213-4545-47ca-bdd5-2591066af743" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-af0fc213-4545-47ca-bdd5-2591066af743" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5393707d-7f63-4b99-95d6-bbb3988a4698]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:15 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743
Sep 22 15:53:15 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:15 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743" returned: 0 in 0.404s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:15 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743
Sep 22 15:53:15 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:16 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-af0fc213-4545-47ca-bdd5-2591066af743" returned: 0 in 0.281s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-quobyte-af0fc213-4545-47ca-bdd5-2591066af743" released by "delete_volume" :: held 0.728s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Created reservations ['a5c4058b-b1ca-412f-99bc-4d0b65e6339a', 'a2773d4f-3c26-4efe-9998-028fd7dd413e', '8296aeec-9d53-4434-8bc9-83f11149ad40', '365dbd3f-9ddd-492c-aa34-9db3f82d6532'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:16 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:53:16 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:16 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.285s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:53:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Deleted volume successfully.
Sep 22 15:53:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bff44ec7-8bc5-405f-8e1f-e1eeae4ffc20 tempest-VolumeDependencyTests-1796431380 None] Lock "cinder-af0fc213-4545-47ca-bdd5-2591066af743-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-c85b41d6-67cb-43e0-8e72-e54427cb1474 req-954ff05e-0606-4016-a5ab-3414fbe2d301 tempest-TestShelveInstance-1497123023 None] Terminate volume connection completed successfully.
Sep 22 15:53:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-c85b41d6-67cb-43e0-8e72-e54427cb1474 req-954ff05e-0606-4016-a5ab-3414fbe2d301 tempest-TestShelveInstance-1497123023 None] Deleting attachment e4794743-5a11-4a95-8bec-c8526b9e11f9. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:53:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-209e62e6-34ff-470a-bf3c-720171bf7953 req-060859a4-a6d5-464c-a6b1-cd52b3ff49c3 tempest-TestShelveInstance-1497123023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-209e62e6-34ff-470a-bf3c-720171bf7953 req-060859a4-a6d5-464c-a6b1-cd52b3ff49c3 tempest-TestShelveInstance-1497123023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-209e62e6-34ff-470a-bf3c-720171bf7953 req-060859a4-a6d5-464c-a6b1-cd52b3ff49c3 tempest-TestShelveInstance-1497123023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-209e62e6-34ff-470a-bf3c-720171bf7953 req-060859a4-a6d5-464c-a6b1-cd52b3ff49c3 tempest-TestShelveInstance-1497123023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4', 'name': 'volume-9643fd47-022a-45ff-bb16-45f488eada00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba5f159c-4847-4025-bf6e-d864a2a99a8d', 'enforce_multipath': True} {{(pid=85987) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 22 15:53:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-209e62e6-34ff-470a-bf3c-720171bf7953 req-060859a4-a6d5-464c-a6b1-cd52b3ff49c3 tempest-TestShelveInstance-1497123023 None] attachment_update completed successfully.
Sep 22 15:53:20 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:53:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Flow 'volume_create_manager' (55b40087-d208-4fc8-b785-4e19290fdb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:53:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb3a0e8-8125-4291-ae00-651064fad332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb3a0e8-8125-4291-ae00-651064fad332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267363554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab39bcda-2275-4f95-b140-0ace99330dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596e7a2ec1c64b29aa9cecd6bc2e9745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:21Z,use_quota=True,user_id='2bf2e659f5ed4e37a9d0b6fe4b5d510c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db969be8-61c8-4d8a-9480-6013b561a195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db969be8-61c8-4d8a-9480-6013b561a195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ed038d-edd5-4a0b-a066-0664dda7213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ed038d-edd5-4a0b-a066-0664dda7213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab39bcda-2275-4f95-b140-0ace99330dad', 'volume_name': 'volume-ab39bcda-2275-4f95-b140-0ace99330dad', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07eb6df-17fc-400b-aed4-9657f6c2f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07eb6df-17fc-400b-aed4-9657f6c2f069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c3f012-dcf8-4585-b0cd-581305d65c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Volume ab39bcda-2275-4f95-b140-0ace99330dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab39bcda-2275-4f95-b140-0ace99330dad', 'volume_size': 1}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267363554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab39bcda-2275-4f95-b140-0ace99330dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596e7a2ec1c64b29aa9cecd6bc2e9745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:21Z,use_quota=True,user_id='2bf2e659f5ed4e37a9d0b6fe4b5d510c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Creating volume ab39bcda-2275-4f95-b140-0ace99330dad {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:53:21 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:21 devstack sudo[103424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad 1073741824
Sep 22 15:53:21 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:21 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad 1073741824" returned: 0 in 0.450s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:21 devstack sudo[103430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad
Sep 22 15:53:21 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:21 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad" returned: 0 in 0.254s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c3f012-dcf8-4585-b0cd-581305d65c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab39bcda-2275-4f95-b140-0ace99330dad', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c62785-d506-48d1-9664-289c85446a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Volume volume-ab39bcda-2275-4f95-b140-0ace99330dad (ab39bcda-2275-4f95-b140-0ace99330dad): created successfully
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c62785-d506-48d1-9664-289c85446a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Flow 'volume_create_manager' (55b40087-d208-4fc8-b785-4e19290fdb25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:53:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8e0b7f3e-d54b-4b5e-b7c9-83c66360d639 tempest-ProjectReaderTests-2068883374 None] Created volume successfully.
Sep 22 15:53:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Acquiring lock "cinder-ab39bcda-2275-4f95-b140-0ace99330dad-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Lock "cinder-ab39bcda-2275-4f95-b140-0ace99330dad-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Acquiring lock "cinder-quobyte-ab39bcda-2275-4f95-b140-0ace99330dad" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Lock "cinder-quobyte-ab39bcda-2275-4f95-b140-0ace99330dad" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:22 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae13dd2-4ee3-46d8-ad37-e3db4f5247ce]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:22 devstack sudo[103433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad
Sep 22 15:53:22 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:22 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad" returned: 0 in 0.409s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:22 devstack sudo[103445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad
Sep 22 15:53:22 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:23 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab39bcda-2275-4f95-b140-0ace99330dad" returned: 0 in 0.268s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Lock "cinder-quobyte-ab39bcda-2275-4f95-b140-0ace99330dad" released by "delete_volume" :: held 0.741s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Created reservations ['c719932c-6739-4263-b2d3-feae146f9ae8', '0e208456-45b0-40b4-a6a3-55624c57a6cd', 'c751bb88-7519-4a48-92de-a4ae0103becb', '1793d672-2f9b-47f9-95a1-291bdd08a8a8'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:23 devstack sudo[103472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:53:23 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:23 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.366s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:53:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Deleted volume successfully.
Sep 22 15:53:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f0c70ef5-b0d0-4e3e-80e0-8d2bc6f2d4ba tempest-ProjectReaderTests-2068883374 None] Lock "cinder-ab39bcda-2275-4f95-b140-0ace99330dad-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Flow 'volume_create_manager' (41d8253c-9343-4094-9bc0-82cca14e8dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f466f1f-44eb-4536-b6fd-0b730fe48692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f466f1f-44eb-4536-b6fd-0b730fe48692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764250124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c71063-97b7-4e82-a74a-7ee4cafd354a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596e7a2ec1c64b29aa9cecd6bc2e9745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:24Z,use_quota=True,user_id='2bf2e659f5ed4e37a9d0b6fe4b5d510c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fa064f-db84-4e68-ac11-8b9ae34266d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fa064f-db84-4e68-ac11-8b9ae34266d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1e05bb-cae3-49cc-9779-c0652a158a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1e05bb-cae3-49cc-9779-c0652a158a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c71063-97b7-4e82-a74a-7ee4cafd354a', 'volume_name': 'volume-98c71063-97b7-4e82-a74a-7ee4cafd354a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ece033a-ea17-457e-b3db-6f3e11b3e8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ece033a-ea17-457e-b3db-6f3e11b3e8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45736da-7e2f-4d6f-acd0-becb2ee6dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:24 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Volume 98c71063-97b7-4e82-a74a-7ee4cafd354a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c71063-97b7-4e82-a74a-7ee4cafd354a', 'volume_size': 1}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764250124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c71063-97b7-4e82-a74a-7ee4cafd354a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596e7a2ec1c64b29aa9cecd6bc2e9745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:24Z,use_quota=True,user_id='2bf2e659f5ed4e37a9d0b6fe4b5d510c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Creating volume 98c71063-97b7-4e82-a74a-7ee4cafd354a {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:53:24 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:53:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:24 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a 1073741824
Sep 22 15:53:24 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:25 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a 1073741824" returned: 0 in 0.492s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:25 devstack sudo[103931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a
Sep 22 15:53:25 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:25 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a" returned: 0 in 0.287s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:53:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45736da-7e2f-4d6f-acd0-becb2ee6dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c71063-97b7-4e82-a74a-7ee4cafd354a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae68a7a8-8b93-40da-807a-4fc67d4b0edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:25 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Volume volume-98c71063-97b7-4e82-a74a-7ee4cafd354a (98c71063-97b7-4e82-a74a-7ee4cafd354a): created successfully
Sep 22 15:53:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae68a7a8-8b93-40da-807a-4fc67d4b0edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Flow 'volume_create_manager' (41d8253c-9343-4094-9bc0-82cca14e8dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:53:25 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2210be39-38e9-40e2-9e75-12ab4c996b8b tempest-ProjectReaderTests-2068883374 None] Created volume successfully.
Sep 22 15:53:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Acquiring lock "cinder-98c71063-97b7-4e82-a74a-7ee4cafd354a-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Lock "cinder-98c71063-97b7-4e82-a74a-7ee4cafd354a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Acquiring lock "cinder-quobyte-98c71063-97b7-4e82-a74a-7ee4cafd354a" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Lock "cinder-quobyte-98c71063-97b7-4e82-a74a-7ee4cafd354a" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:26 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f49097a-9cc5-4166-aead-f9acc70d6127]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:26 devstack sudo[103936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a
Sep 22 15:53:26 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:27 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a" returned: 0 in 0.404s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:27 devstack sudo[103941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a
Sep 22 15:53:27 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:27 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-98c71063-97b7-4e82-a74a-7ee4cafd354a" returned: 0 in 0.249s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Lock "cinder-quobyte-98c71063-97b7-4e82-a74a-7ee4cafd354a" released by "delete_volume" :: held 0.713s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Created reservations ['d48fd6de-2ba2-4e5a-a7ca-32c3c561f5f6', '3020604f-8ab7-4104-a5a6-398a5f4fbeec', '2b856ab4-3221-4b9c-9374-a15c48e3fd7d', '87bc436d-f3d2-4955-81b4-63d647da4245'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:27 devstack sudo[103944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:53:27 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:27 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.300s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:53:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Deleted volume successfully.
Sep 22 15:53:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6c49689b-8e41-477b-9fe5-244dd0715f6e tempest-ProjectReaderTests-2068883374 None] Lock "cinder-98c71063-97b7-4e82-a74a-7ee4cafd354a-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:53:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:53:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:28 devstack sudo[103947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:53:28 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:29 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.347s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:53:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:53:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 29 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:53:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>, <Thread(Rabbit-heartbeat, started daemon 139419795786048)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:53:37 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=127,cinder:UPDATE=150,cinder:INSERT=40,cinder:DELETE=9 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:53:37 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=107,cinder:UPDATE=124,cinder:INSERT=44,cinder:DELETE=15 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:53:49 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Flow 'volume_create_manager' (1cf6ccc1-26e8-4f6c-af75-5119c28acd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80473224-863b-4055-82e6-4b44391730b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80473224-863b-4055-82e6-4b44391730b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-569622659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c474482-b11e-4eb3-a13f-7c3941a209c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d897466f1f92486bae68f597c9c52b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:52Z,use_quota=True,user_id='1d59bd673b464f4a87f6a6c3b25f215c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859d59b4-5cc3-41f4-9db8-38c83ae8210a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859d59b4-5cc3-41f4-9db8-38c83ae8210a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd88d596-47cc-4a7c-9d3f-4943b09835ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd88d596-47cc-4a7c-9d3f-4943b09835ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c474482-b11e-4eb3-a13f-7c3941a209c0', 'volume_name': 'volume-5c474482-b11e-4eb3-a13f-7c3941a209c0', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb756018-177e-4592-8abc-413dc6b56b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb756018-177e-4592-8abc-413dc6b56b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08430252-ffc8-4678-a9b8-3a6bdf756e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:52 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Volume 5c474482-b11e-4eb3-a13f-7c3941a209c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c474482-b11e-4eb3-a13f-7c3941a209c0', 'volume_size': 1}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-569622659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c474482-b11e-4eb3-a13f-7c3941a209c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d897466f1f92486bae68f597c9c52b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:52Z,use_quota=True,user_id='1d59bd673b464f4a87f6a6c3b25f215c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Creating volume 5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:53:52 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:52 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 1073741824
Sep 22 15:53:52 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:52 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 1073741824" returned: 0 in 0.422s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:52 devstack sudo[104000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0
Sep 22 15:53:52 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:53 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0" returned: 0 in 0.264s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08430252-ffc8-4678-a9b8-3a6bdf756e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c474482-b11e-4eb3-a13f-7c3941a209c0', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf84bb8-e6fd-454a-9ae2-418d38e092b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:53 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Volume volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 (5c474482-b11e-4eb3-a13f-7c3941a209c0): created successfully
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf84bb8-e6fd-454a-9ae2-418d38e092b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Flow 'volume_create_manager' (1cf6ccc1-26e8-4f6c-af75-5119c28acd0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:53:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7ff64d86-a54d-4589-bbb6-08664dd14ae7 tempest-SnapshotDependencyTests-1680028354 None] Created volume successfully.
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Creating offline snapshot ccad24f6-fc9d-4ff6-a142-0c7652081926 of volume 5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3837c0-add4-4609-904d-7b7d25c74d9d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:53 devstack sudo[104003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0
Sep 22 15:53:53 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:53 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0" returned: 0 in 0.373s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:53 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 1G
Sep 22 15:53:53 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:54 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 1G" returned: 0 in 0.406s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:54 devstack sudo[104014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926
Sep 22 15:53:54 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:54 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926" returned: 0 in 0.278s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:54 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 is being set with open permissions: ugo+rw
Sep 22 15:53:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:54 devstack sudo[104019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926
Sep 22 15:53:54 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:54 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926" returned: 0 in 0.241s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:54 devstack sudo[104022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.info
Sep 22 15:53:54 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:55 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.info" returned: 0 in 0.261s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:55 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.info is being set with open permissions: ugo+rw
Sep 22 15:53:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:55 devstack sudo[104025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.info
Sep 22 15:53:55 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:55 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.info" returned: 0 in 0.251s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:55 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-dd99999d-34f0-4403-aa84-4b0279acf40a tempest-SnapshotDependencyTests-1680028354 None] Create snapshot completed successfully
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Flow 'volume_create_manager' (cf91e4db-162d-4cd2-8577-6b1b85bef378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b727c3d-383b-4b7a-b547-7afc07ce442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b727c3d-383b-4b7a-b547-7afc07ce442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0ef7c4-d18e-45ea-9f42-210799e554ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d897466f1f92486bae68f597c9c52b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ccad24f6-fc9d-4ff6-a142-0c7652081926,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:53:56Z,use_quota=True,user_id='1d59bd673b464f4a87f6a6c3b25f215c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1865fdbf-e8ad-4230-938f-acf3cfc1a89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1865fdbf-e8ad-4230-938f-acf3cfc1a89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceeff1dd-f8e5-4d66-a4c5-6050d4d08f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceeff1dd-f8e5-4d66-a4c5-6050d4d08f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da0ef7c4-d18e-45ea-9f42-210799e554ec', 'volume_name': 'volume-da0ef7c4-d18e-45ea-9f42-210799e554ec', 'volume_size': 1, 'snapshot_id': 'ccad24f6-fc9d-4ff6-a142-0c7652081926'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512c7a55-066a-4f48-8e02-93207f6f78c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512c7a55-066a-4f48-8e02-93207f6f78c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef06efd-27e9-4ba0-9680-cb3739adbe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:53:56 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Volume da0ef7c4-d18e-45ea-9f42-210799e554ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da0ef7c4-d18e-45ea-9f42-210799e554ec', 'volume_size': 1, 'snapshot_id': 'ccad24f6-fc9d-4ff6-a142-0c7652081926'}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "cinder-quobyte-ccad24f6-fc9d-4ff6-a142-0c7652081926-da0ef7c4-d18e-45ea-9f42-210799e554ec" by "_create_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-ccad24f6-fc9d-4ff6-a142-0c7652081926-da0ef7c4-d18e-45ea-9f42-210799e554ec" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Creating volume da0ef7c4-d18e-45ea-9f42-210799e554ec from snapshot ccad24f6-fc9d-4ff6-a142-0c7652081926 {{(pid=85987) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "cinder-quobyte-da0ef7c4-d18e-45ea-9f42-210799e554ec" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-da0ef7c4-d18e-45ea-9f42-210799e554ec" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] snapshot: ccad24f6-fc9d-4ff6-a142-0c7652081926, volume: da0ef7c4-d18e-45ea-9f42-210799e554ec,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92c5327-fbc6-49b2-bde9-f4ce3efda83c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:56 devstack sudo[104028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926
Sep 22 15:53:56 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:56 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926" returned: 0 in 0.367s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c474482-b11e-4eb3-a13f-7c3941a209c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e53204-5ce1-47b6-8c48-143b7bce1626]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:53:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:56 devstack sudo[104033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0
Sep 22 15:53:56 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:53:57 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root
Sep 22 15:53:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0" returned: 0 in 0.381s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:53:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:53:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:53:57 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:53:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:53:57 devstack sudo[104038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec
Sep 22 15:53:57 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:02 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec" returned: 0 in 5.879s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:02 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:54:02 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Converted 1024.00 MB image at 174.14 MB/s
Sep 22 15:54:02 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec is being set with open permissions: ugo+rw
Sep 22 15:54:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:02 devstack sudo[104057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec
Sep 22 15:54:02 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:03 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec" returned: 0 in 0.247s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-da0ef7c4-d18e-45ea-9f42-210799e554ec" released by "_copy_volume_from_snapshot" :: held 6.956s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-ccad24f6-fc9d-4ff6-a142-0c7652081926-da0ef7c4-d18e-45ea-9f42-210799e554ec" released by "_create_volume_from_snapshot" :: held 7.018s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.032s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef06efd-27e9-4ba0-9680-cb3739adbe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0ef7c4-d18e-45ea-9f42-210799e554ec', 'volume_size': 1, 'snapshot_id': 'ccad24f6-fc9d-4ff6-a142-0c7652081926'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342bc93a-5675-4fcb-beda-aa38122acd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:03 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Volume volume-da0ef7c4-d18e-45ea-9f42-210799e554ec (da0ef7c4-d18e-45ea-9f42-210799e554ec): created successfully
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342bc93a-5675-4fcb-beda-aa38122acd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Flow 'volume_create_manager' (cf91e4db-162d-4cd2-8577-6b1b85bef378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:03 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c77c2171-3190-4c19-8c13-c5b6069e84be tempest-SnapshotDependencyTests-1680028354 None] Created volume successfully.
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "cinder-ccad24f6-fc9d-4ff6-a142-0c7652081926-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-ccad24f6-fc9d-4ff6-a142-0c7652081926-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "cinder-quobyte-5c474482-b11e-4eb3-a13f-7c3941a209c0" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-5c474482-b11e-4eb3-a13f-7c3941a209c0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "cinder-quobyte-ccad24f6-fc9d-4ff6-a142-0c7652081926" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-ccad24f6-fc9d-4ff6-a142-0c7652081926" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Deleting offline snapshot ccad24f6-fc9d-4ff6-a142-0c7652081926 of volume 5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] snapshot_file for this snap is: volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b5b6d-d8b1-490e-84a1-2ea30ca2958d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:03 devstack sudo[104062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926
Sep 22 15:54:03 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:04 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926" returned: 0 in 0.462s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c474482-b11e-4eb3-a13f-7c3941a209c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:54:04 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a87b55-c0a8-41ee-88d8-d0f545ae7048]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:04 devstack sudo[104073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0
Sep 22 15:54:04 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:05 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0" returned: 0 in 0.713s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:05 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926
Sep 22 15:54:05 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:05 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926" returned: 0 in 0.434s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:05 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-05f73364-f067-4413-a1cc-443a5af21285 tempest-TestShelveInstance-1497123023 None] Terminate volume connection completed successfully.
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-05f73364-f067-4413-a1cc-443a5af21285 tempest-TestShelveInstance-1497123023 None] Deleting attachment ba5f159c-4847-4025-bf6e-d864a2a99a8d. {{(pid=85987) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 22 15:54:05 devstack sudo[104102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926
Sep 22 15:54:05 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Acquiring lock "cinder-9643fd47-022a-45ff-bb16-45f488eada00-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Lock "cinder-9643fd47-022a-45ff-bb16-45f488eada00-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Acquiring lock "cinder-quobyte-9643fd47-022a-45ff-bb16-45f488eada00" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:05 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Lock "cinder-quobyte-9643fd47-022a-45ff-bb16-45f488eada00" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0.ccad24f6-fc9d-4ff6-a142-0c7652081926" returned: 0 in 0.280s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3c7d2b-9f89-4b6f-9569-6f4033e1c07b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-ccad24f6-fc9d-4ff6-a142-0c7652081926" released by "_delete_snapshot" :: held 2.032s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-5c474482-b11e-4eb3-a13f-7c3941a209c0" released by "delete_snapshot" :: held 2.058s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:05 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Created reservations ['65e5fdff-3ce9-4a8a-a697-7ab8ad04ee48', '1d83d1f0-73d2-45b3-9be2-a76cafb39904', '4b52e18c-895b-48e0-9b0e-6876b20c0c14', '917c1747-c322-4746-a128-1fe791eee4a1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:05 devstack sudo[104105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00
Sep 22 15:54:05 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Delete snapshot completed successfully.
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9cc7ebaf-f65e-433c-8d8f-8cd4ecdc93ef tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-ccad24f6-fc9d-4ff6-a142-0c7652081926-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:06 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00" returned: 0 in 0.411s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:06 devstack sudo[104110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00
Sep 22 15:54:06 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:06 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9643fd47-022a-45ff-bb16-45f488eada00" returned: 0 in 0.256s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Lock "cinder-quobyte-9643fd47-022a-45ff-bb16-45f488eada00" released by "delete_volume" :: held 0.739s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG cinder.quota [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Created reservations ['b6d1fa9f-dcc8-4383-bed6-da1e04da765c', 'ff044ed0-692d-4566-b06c-90c534e970e9', '7cd7f3aa-cfef-4d92-a7bc-7aca377bc4ee', 'aefa342b-be66-422f-b9dd-f7edd2250a8b'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:06 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:06 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:06 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.248s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG cinder.manager [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Deleted volume successfully.
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [req-96a5920e-cd8a-45ec-a8e6-8b72aed0f0ed req-fb977455-9e3d-4852-8249-5170885f8923 tempest-TestShelveInstance-1497123023 None] Lock "cinder-9643fd47-022a-45ff-bb16-45f488eada00-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "cinder-5c474482-b11e-4eb3-a13f-7c3941a209c0-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-5c474482-b11e-4eb3-a13f-7c3941a209c0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "cinder-quobyte-5c474482-b11e-4eb3-a13f-7c3941a209c0" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-5c474482-b11e-4eb3-a13f-7c3941a209c0" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa67e9a-a3ab-4fa7-a508-ef205859ec78]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:07 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0
Sep 22 15:54:07 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:07 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0" returned: 0 in 0.375s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:07 devstack sudo[104121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0
Sep 22 15:54:07 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:07 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-5c474482-b11e-4eb3-a13f-7c3941a209c0" returned: 0 in 0.274s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-5c474482-b11e-4eb3-a13f-7c3941a209c0" released by "delete_volume" :: held 0.719s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Created reservations ['64aa3ec2-edc6-4b39-b631-9d32e12da99e', 'b4e29aec-9cc2-465a-b502-4ef5d6c7fd41', '1e929f13-24ff-4019-8c35-e0ef89e55160', '2c5a1182-1082-4675-9321-5567d2677abb'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:07 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:07 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:08 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.269s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:08 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Deleted volume successfully.
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "cinder-da0ef7c4-d18e-45ea-9f42-210799e554ec-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-91ceca0d-9ff7-44e6-8515-0d5dacf40d53 tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-5c474482-b11e-4eb3-a13f-7c3941a209c0-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-da0ef7c4-d18e-45ea-9f42-210799e554ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "cinder-quobyte-da0ef7c4-d18e-45ea-9f42-210799e554ec" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-da0ef7c4-d18e-45ea-9f42-210799e554ec" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e23923-96e8-48da-be13-9726251cc24a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:08 devstack sudo[104127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec
Sep 22 15:54:08 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:08 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec" returned: 0 in 0.381s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:08 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec
Sep 22 15:54:08 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:08 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-da0ef7c4-d18e-45ea-9f42-210799e554ec" returned: 0 in 0.249s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-quobyte-da0ef7c4-d18e-45ea-9f42-210799e554ec" released by "delete_volume" :: held 0.678s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Created reservations ['e13655e2-9fce-42fe-afe2-1d93675fdd3d', 'f314cbbe-6eec-4747-8908-ebd4fd39c9a5', 'c3924a8d-b529-47b2-8d41-8af3279790a0', 'debeccac-2acd-4ee0-a4d9-f04f261d62d8'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:09 devstack sudo[104136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:09 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:09 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.310s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:09 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Deleted volume successfully.
Sep 22 15:54:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-129d37fa-0e38-4292-b4d6-f8bfab755ff0 tempest-SnapshotDependencyTests-1680028354 None] Lock "cinder-da0ef7c4-d18e-45ea-9f42-210799e554ec-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=35,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=8 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=41,cinder:INSERT=11,cinder:SELECT=26,cinder:DELETE=3 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (3f17b84a-b82c-40bc-b9ba-ea0747ad744c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f798f7db-b044-4b7e-a21b-1f09658ab9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f798f7db-b044-4b7e-a21b-1f09658ab9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637735937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5d25c3-25d2-474a-a201-6ac49e36eeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:20Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4704a66-0563-41d5-874c-109dff42ed22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4704a66-0563-41d5-874c-109dff42ed22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae20f7c6-21e6-4d1f-8f67-dd073cadda64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae20f7c6-21e6-4d1f-8f67-dd073cadda64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5d25c3-25d2-474a-a201-6ac49e36eeca', 'volume_name': 'volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd27946-75f8-4cfd-b6b9-f1db9f217f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd27946-75f8-4cfd-b6b9-f1db9f217f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d6c95a-f3ae-474c-9b20-8924cbef8e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:19 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Volume 1d5d25c3-25d2-474a-a201-6ac49e36eeca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca', 'volume_size': 1}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637735937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5d25c3-25d2-474a-a201-6ac49e36eeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:20Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Creating volume 1d5d25c3-25d2-474a-a201-6ac49e36eeca {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:19 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:19 devstack sudo[104183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca 1073741824
Sep 22 15:54:19 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (5ccd84bd-8eee-4686-a9fb-c2aca421d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7309c5e7-b706-4612-8cc2-0d124b25fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7309c5e7-b706-4612-8cc2-0d124b25fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1534371810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7cba313-e7e5-445a-acc1-0f24f1ad8f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:20Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa6fead-a9b7-43d0-be03-df62f5a442f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa6fead-a9b7-43d0-be03-df62f5a442f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97140dc-c136-4f68-9869-0cfa7889d2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97140dc-c136-4f68-9869-0cfa7889d2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7cba313-e7e5-445a-acc1-0f24f1ad8f13', 'volume_name': 'volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908e34a3-9759-4a59-aadc-696b93a1fec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908e34a3-9759-4a59-aadc-696b93a1fec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33ed76c-ea2b-44fa-8baa-0a5d5ea16b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Volume e7cba313-e7e5-445a-acc1-0f24f1ad8f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13', 'volume_size': 1}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:20 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca 1073741824" returned: 0 in 0.559s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:20 devstack sudo[104190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca
Sep 22 15:54:20 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (66ce0108-738a-4f58-b49b-90ac2ab2e405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807b689e-c3c3-4438-9020-11ca0be0f2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807b689e-c3c3-4438-9020-11ca0be0f2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507945606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df00df9f-da75-4ec5-a032-8ce04fbee74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:21Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b5eff-0a97-4142-a346-41f1028a89ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b5eff-0a97-4142-a346-41f1028a89ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938cf984-30d1-4b8a-b659-71f146a96bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938cf984-30d1-4b8a-b659-71f146a96bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df00df9f-da75-4ec5-a032-8ce04fbee74c', 'volume_name': 'volume-df00df9f-da75-4ec5-a032-8ce04fbee74c', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d24e8bb-a906-4f9b-82db-be24db85a31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d24e8bb-a906-4f9b-82db-be24db85a31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fb43fa-bc7f-414e-a0da-1e9705d36d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Volume df00df9f-da75-4ec5-a032-8ce04fbee74c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df00df9f-da75-4ec5-a032-8ce04fbee74c', 'volume_size': 1}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:20 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca" returned: 0 in 0.285s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1534371810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7cba313-e7e5-445a-acc1-0f24f1ad8f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:20Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Creating volume e7cba313-e7e5-445a-acc1-0f24f1ad8f13 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:20 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d6c95a-f3ae-474c-9b20-8924cbef8e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack sudo[104193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13 1073741824
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a7650e-96b8-4ced-8314-bbd9a02dda05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:20 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:20 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Volume volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca (1d5d25c3-25d2-474a-a201-6ac49e36eeca): created successfully
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a7650e-96b8-4ced-8314-bbd9a02dda05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (3f17b84a-b82c-40bc-b9ba-ea0747ad744c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3bbf9c3e-8db1-4ed1-99f7-bcc11f62928c tempest-CreateVolumesFromImageTest-443124700 None] Created volume successfully.
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (c2848ae9-909a-456b-9b2e-f38d0550e730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faf9da8-7cb6-48ce-9011-e5dcefd90664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faf9da8-7cb6-48ce-9011-e5dcefd90664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-755697828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec480729-5eea-4891-b045-d9a9cbb71c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:21Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf37721-bf68-4cc3-8be5-db16e6fa249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf37721-bf68-4cc3-8be5-db16e6fa249d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345714c8-1676-4324-80e8-e7ffb9ceb0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345714c8-1676-4324-80e8-e7ffb9ceb0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec480729-5eea-4891-b045-d9a9cbb71c6c', 'volume_name': 'volume-ec480729-5eea-4891-b045-d9a9cbb71c6c', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6777170-26b2-4a9e-a6b3-34a1d24338bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6777170-26b2-4a9e-a6b3-34a1d24338bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967f8f9b-5aee-40d3-b986-3049e3d2d228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Volume ec480729-5eea-4891-b045-d9a9cbb71c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec480729-5eea-4891-b045-d9a9cbb71c6c', 'volume_size': 1}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:21 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13 1073741824" returned: 0 in 0.515s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:21 devstack sudo[104199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13
Sep 22 15:54:21 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (6ae7eedc-4af1-4874-a401-e8122a63f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d19cfb3-d0bf-4fa4-af87-71f030480fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d19cfb3-d0bf-4fa4-af87-71f030480fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714017744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ba11ec-375e-49d1-9d03-95549d6f7859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:21Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c298d35-d9ba-4c69-bdfc-e13dacfe7fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c298d35-d9ba-4c69-bdfc-e13dacfe7fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf871b03-515e-44fc-8555-c89b6e495c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf871b03-515e-44fc-8555-c89b6e495c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ba11ec-375e-49d1-9d03-95549d6f7859', 'volume_name': 'volume-c5ba11ec-375e-49d1-9d03-95549d6f7859', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d6dcb8-819f-4123-8e61-bf2720ae2162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d6dcb8-819f-4123-8e61-bf2720ae2162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c191b39-323f-4ca7-8252-9c90032e7445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Volume c5ba11ec-375e-49d1-9d03-95549d6f7859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ba11ec-375e-49d1-9d03-95549d6f7859', 'volume_size': 1}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:21 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13" returned: 0 in 0.248s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507945606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df00df9f-da75-4ec5-a032-8ce04fbee74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:21Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Creating volume df00df9f-da75-4ec5-a032-8ce04fbee74c {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:21 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:21 devstack sudo[104202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c 1073741824
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33ed76c-ea2b-44fa-8baa-0a5d5ea16b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1b576a-3c3d-401e-be17-a351ff105684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Volume volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13 (e7cba313-e7e5-445a-acc1-0f24f1ad8f13): created successfully
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1b576a-3c3d-401e-be17-a351ff105684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (5ccd84bd-8eee-4686-a9fb-c2aca421d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a4d85f1b-1970-4f1a-b08f-442b4fbb8cea tempest-CreateVolumesFromImageTest-443124700 None] Created volume successfully.
Sep 22 15:54:22 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c 1073741824" returned: 0 in 0.420s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:22 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c
Sep 22 15:54:22 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:22 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c" returned: 0 in 0.248s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-755697828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec480729-5eea-4891-b045-d9a9cbb71c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:21Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Creating volume ec480729-5eea-4891-b045-d9a9cbb71c6c {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:22 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fb43fa-bc7f-414e-a0da-1e9705d36d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df00df9f-da75-4ec5-a032-8ce04fbee74c', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844d41a3-4080-4b00-9123-27c178dcab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:22 devstack sudo[104211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c 1073741824
Sep 22 15:54:22 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:22 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Volume volume-df00df9f-da75-4ec5-a032-8ce04fbee74c (df00df9f-da75-4ec5-a032-8ce04fbee74c): created successfully
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844d41a3-4080-4b00-9123-27c178dcab41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (66ce0108-738a-4f58-b49b-90ac2ab2e405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:22 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-07f6527d-b846-4a03-b7f8-b79e4c1e17ab tempest-CreateVolumesFromImageTest-443124700 None] Created volume successfully.
Sep 22 15:54:22 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c 1073741824" returned: 0 in 0.430s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:22 devstack sudo[104223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c
Sep 22 15:54:22 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:23 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c" returned: 0 in 0.248s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714017744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ba11ec-375e-49d1-9d03-95549d6f7859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b924d87e8456db308104c4208404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:21Z,use_quota=True,user_id='7b41f07bc76e4ca1a74a6b1c2fc8d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Creating volume c5ba11ec-375e-49d1-9d03-95549d6f7859 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:23 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967f8f9b-5aee-40d3-b986-3049e3d2d228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec480729-5eea-4891-b045-d9a9cbb71c6c', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:23 devstack sudo[104226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859 1073741824
Sep 22 15:54:23 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7a2a5a-093b-4ce3-9233-fcfbabb860aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:23 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Volume volume-ec480729-5eea-4891-b045-d9a9cbb71c6c (ec480729-5eea-4891-b045-d9a9cbb71c6c): created successfully
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7a2a5a-093b-4ce3-9233-fcfbabb860aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (c2848ae9-909a-456b-9b2e-f38d0550e730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3a19b3d7-c895-47b8-9804-de06050bec42 tempest-CreateVolumesFromImageTest-443124700 None] Created volume successfully.
Sep 22 15:54:23 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859 1073741824" returned: 0 in 0.404s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:23 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859
Sep 22 15:54:23 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:23 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859" returned: 0 in 0.247s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c191b39-323f-4ca7-8252-9c90032e7445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ba11ec-375e-49d1-9d03-95549d6f7859', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86541967-d401-4695-9992-26c27580ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:23 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Volume volume-c5ba11ec-375e-49d1-9d03-95549d6f7859 (c5ba11ec-375e-49d1-9d03-95549d6f7859): created successfully
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86541967-d401-4695-9992-26c27580ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Flow 'volume_create_manager' (6ae7eedc-4af1-4874-a401-e8122a63f38a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f466f15a-5bf2-43f7-b40b-cc8d69139376 tempest-CreateVolumesFromImageTest-443124700 None] Created volume successfully.
Sep 22 15:54:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-c5ba11ec-375e-49d1-9d03-95549d6f7859-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-c5ba11ec-375e-49d1-9d03-95549d6f7859-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-quobyte-c5ba11ec-375e-49d1-9d03-95549d6f7859" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-c5ba11ec-375e-49d1-9d03-95549d6f7859" acquired by "delete_volume" :: waited 0.014s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:24 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f53d2c-33f1-483e-9ed2-b9450f3c76aa]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:25 devstack sudo[104234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859
Sep 22 15:54:25 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:25 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859" returned: 0 in 0.369s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:25 devstack sudo[104239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859
Sep 22 15:54:25 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:25 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c5ba11ec-375e-49d1-9d03-95549d6f7859" returned: 0 in 0.251s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-c5ba11ec-375e-49d1-9d03-95549d6f7859" released by "delete_volume" :: held 0.661s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Created reservations ['7cc31d03-9ebf-43b4-bae5-15ffe2c41fa6', 'f59223f7-6542-4cfc-8775-908bba3e0025', '1c5d2e4d-87b9-4164-88eb-f36746a378bb', '700dbae2-59e7-4cb8-ade7-a24de20abe65'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:25 devstack sudo[104242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:25 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:25 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.251s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:25 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Deleted volume successfully.
Sep 22 15:54:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-73627f77-4158-403c-b5fe-744716079f7f tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-c5ba11ec-375e-49d1-9d03-95549d6f7859-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-ec480729-5eea-4891-b045-d9a9cbb71c6c-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-ec480729-5eea-4891-b045-d9a9cbb71c6c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-quobyte-ec480729-5eea-4891-b045-d9a9cbb71c6c" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-ec480729-5eea-4891-b045-d9a9cbb71c6c" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7a948f-602a-40e1-bdfd-e64738927acf]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:26 devstack sudo[104245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c
Sep 22 15:54:26 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:26 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c" returned: 0 in 0.351s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:26 devstack sudo[104250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c
Sep 22 15:54:26 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:26 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ec480729-5eea-4891-b045-d9a9cbb71c6c" returned: 0 in 0.243s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-ec480729-5eea-4891-b045-d9a9cbb71c6c" released by "delete_volume" :: held 0.635s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Created reservations ['d9d552b7-3d49-47ff-96bb-c721e25a79dc', '2bdf44e9-cfe7-4e22-9b82-039f4d3ec6c7', 'a9c7c5f2-eea6-4c0a-a469-bc435b609b02', '8df848e5-fea5-4300-a289-2b858dbddbde'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:26 devstack sudo[104253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:26 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:27 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.242s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Deleted volume successfully.
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-903bc505-d6ae-48d9-9d5f-659e7736e1ba tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-ec480729-5eea-4891-b045-d9a9cbb71c6c-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-df00df9f-da75-4ec5-a032-8ce04fbee74c-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-df00df9f-da75-4ec5-a032-8ce04fbee74c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-quobyte-df00df9f-da75-4ec5-a032-8ce04fbee74c" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-df00df9f-da75-4ec5-a032-8ce04fbee74c" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a24186-588c-4db7-b2d4-52fe66d65f1b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:27 devstack sudo[104256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c
Sep 22 15:54:27 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:27 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c" returned: 0 in 0.357s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:27 devstack sudo[104261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c
Sep 22 15:54:27 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:27 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-df00df9f-da75-4ec5-a032-8ce04fbee74c" returned: 0 in 0.241s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-df00df9f-da75-4ec5-a032-8ce04fbee74c" released by "delete_volume" :: held 0.638s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Created reservations ['0cfe4737-da4c-4242-86d2-8184e57af136', '942581cc-f38d-47a0-bf3d-5a5429e70943', 'c600c36b-0d43-4940-bd39-b635413c264b', '9b017211-46fd-4a8a-9717-f9309968c8e0'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:28 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:28 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:28 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.241s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:28 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Deleted volume successfully.
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e5d377f-82e3-4029-86f2-90492f564cbc tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-df00df9f-da75-4ec5-a032-8ce04fbee74c-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-e7cba313-e7e5-445a-acc1-0f24f1ad8f13-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-e7cba313-e7e5-445a-acc1-0f24f1ad8f13-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-quobyte-e7cba313-e7e5-445a-acc1-0f24f1ad8f13" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-e7cba313-e7e5-445a-acc1-0f24f1ad8f13" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31bb9b7-6959-42ef-b998-b6d0176d895e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:28 devstack sudo[104267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13
Sep 22 15:54:28 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:28 devstack sudo[104271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:28 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:28 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13" returned: 0 in 0.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:28 devstack sudo[104274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13
Sep 22 15:54:28 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:28 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.248s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 29 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:54:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>, <Thread(Rabbit-heartbeat, started daemon 139419795786048)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:54:29 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e7cba313-e7e5-445a-acc1-0f24f1ad8f13" returned: 0 in 0.253s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-e7cba313-e7e5-445a-acc1-0f24f1ad8f13" released by "delete_volume" :: held 0.669s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Created reservations ['131cd425-d48f-44b8-baa2-47832e2a89f8', '0dcc7d52-e3cf-4ab5-adf8-f850d7edfee9', '22422975-b6a7-4c0c-8fb5-0dfdef407811', '149d125e-ce67-4cd4-9f3e-9ec6a7eb3109'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:29 devstack sudo[104278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:29 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:29 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.234s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Deleted volume successfully.
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b48dd1a-51dc-46ef-915c-e19b690d0ee3 tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-e7cba313-e7e5-445a-acc1-0f24f1ad8f13-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-1d5d25c3-25d2-474a-a201-6ac49e36eeca-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-1d5d25c3-25d2-474a-a201-6ac49e36eeca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "cinder-quobyte-1d5d25c3-25d2-474a-a201-6ac49e36eeca" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-1d5d25c3-25d2-474a-a201-6ac49e36eeca" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d616effe-5baa-48cc-b25e-b6d1a94fc147]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:29 devstack sudo[104281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca
Sep 22 15:54:29 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:29 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca" returned: 0 in 0.352s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:29 devstack sudo[104286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca
Sep 22 15:54:29 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:30 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1d5d25c3-25d2-474a-a201-6ac49e36eeca" returned: 0 in 0.247s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-quobyte-1d5d25c3-25d2-474a-a201-6ac49e36eeca" released by "delete_volume" :: held 0.636s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Created reservations ['e8be383f-455d-4752-88b2-f7f969a946c1', '5b04750b-28aa-4866-a992-2f9bfbfeab7e', '9027b154-2051-4090-83be-3ab672d64529', '1ecef21c-3920-4c5e-8ea0-9591c3966c31'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:30 devstack sudo[104289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:30 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:30 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.240s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:30 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Deleted volume successfully.
Sep 22 15:54:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-135e9d82-2acc-4f82-b2c1-2c87086ad868 tempest-CreateVolumesFromImageTest-443124700 None] Lock "cinder-1d5d25c3-25d2-474a-a201-6ac49e36eeca-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Flow 'volume_create_manager' (873332b8-f50f-41d5-be46-05ec6c8fa985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b280646-6196-4406-a9bc-720e3d54c8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b280646-6196-4406-a9bc-720e3d54c8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe377969-157c-4f2e-8811-e21ed42b5d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009969872d244f74b1ee3a0d4c25a3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:35Z,use_quota=True,user_id='b6331d4765a74715a30b286aff10fd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572b95a1-3a4f-430c-a532-03610d2d9cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572b95a1-3a4f-430c-a532-03610d2d9cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7942b8-d63e-48e4-8f20-4d218ba7def6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7942b8-d63e-48e4-8f20-4d218ba7def6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe377969-157c-4f2e-8811-e21ed42b5d81', 'volume_name': 'volume-fe377969-157c-4f2e-8811-e21ed42b5d81', 'volume_size': 1, 'image_id': '56346596-58e3-4d54-8fe4-70e5fc8eba17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56346596-58e3-4d54-8fe4-70e5fc8eba17', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c0b83cac44f6be5ee243236a3580fa7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '009969872d244f74b1ee3a0d4c25a3d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0dd081a5a512c7d06a2d45dd8393500d3056b40324a16b4d23c348063cf26b50f1521f35fef0413242f93e76298ffc12f65ffb3d67e2fa964512f0fcde204a9', 'id': '56346596-58e3-4d54-8fe4-70e5fc8eba17', 'created_at': datetime.datetime(2026, 9, 22, 13, 54, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 54, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56346596-58e3-4d54-8fe4-70e5fc8eba17/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd292abe90>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530cbbcb-866b-46a0-842c-04f34ff2a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530cbbcb-866b-46a0-842c-04f34ff2a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aedaf7-0253-4ae7-8c4d-030ac82e33e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:35 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Volume fe377969-157c-4f2e-8811-e21ed42b5d81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe377969-157c-4f2e-8811-e21ed42b5d81', 'volume_size': 1, 'image_id': '56346596-58e3-4d54-8fe4-70e5fc8eba17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56346596-58e3-4d54-8fe4-70e5fc8eba17', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c0b83cac44f6be5ee243236a3580fa7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '009969872d244f74b1ee3a0d4c25a3d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0dd081a5a512c7d06a2d45dd8393500d3056b40324a16b4d23c348063cf26b50f1521f35fef0413242f93e76298ffc12f65ffb3d67e2fa964512f0fcde204a9', 'id': '56346596-58e3-4d54-8fe4-70e5fc8eba17', 'created_at': datetime.datetime(2026, 9, 22, 13, 54, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 54, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56346596-58e3-4d54-8fe4-70e5fc8eba17/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd292abe90>}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Trying to clone fe377969-157c-4f2e-8811-e21ed42b5d81 from image 56346596-58e3-4d54-8fe4-70e5fc8eba17 at location (None, [{'url': 'file:///opt/stack/data/glance/images/56346596-58e3-4d54-8fe4-70e5fc8eba17', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:54:35 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Image download 0.00 MB at 0.00 MB/s
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcf71de-e7c1-4774-af85-dfb09eba6df8]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:35 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD
Sep 22 15:54:35 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:36 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:36 devstack sudo[104298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD
Sep 22 15:54:36 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:36 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:54:36 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Temporary image 56346596-58e3-4d54-8fe4-70e5fc8eba17 is fetched for user b6331d4765a74715a30b286aff10fd89. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:54:36 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0503a21-e918-470b-a797-9117e000bc39]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:36 devstack sudo[104303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD
Sep 22 15:54:36 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:36 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:36 devstack sudo[104307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD
Sep 22 15:54:36 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:37 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe377969-157c-4f2e-8811-e21ed42b5d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009969872d244f74b1ee3a0d4c25a3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:35Z,use_quota=True,user_id='b6331d4765a74715a30b286aff10fd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Creating volume fe377969-157c-4f2e-8811-e21ed42b5d81 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:37 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:37 devstack sudo[104312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 1073741824
Sep 22 15:54:37 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:37 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 1073741824" returned: 0 in 0.415s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:37 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81
Sep 22 15:54:37 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:37 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81" returned: 0 in 0.247s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Attempting download of 56346596-58e3-4d54-8fe4-70e5fc8eba17 ((None, [{'url': 'file:///opt/stack/data/glance/images/56346596-58e3-4d54-8fe4-70e5fc8eba17', 'metadata': {}}])) to volume fe377969-157c-4f2e-8811-e21ed42b5d81. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff78f4e-7d64-4a19-b3e6-c0beda9dfdd2]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56346596-58e3-4d54-8fe4-70e5fc8eba17__elsu6i3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:38 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56346596-58e3-4d54-8fe4-70e5fc8eba17__elsu6i3
Sep 22 15:54:38 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:38 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56346596-58e3-4d54-8fe4-70e5fc8eba17__elsu6i3" returned: 0 in 0.328s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56346596-58e3-4d54-8fe4-70e5fc8eba17__elsu6i3 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:38 devstack sudo[104326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56346596-58e3-4d54-8fe4-70e5fc8eba17__elsu6i3
Sep 22 15:54:38 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:38 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56346596-58e3-4d54-8fe4-70e5fc8eba17__elsu6i3" returned: 1 in 0.310s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56346596-58e3-4d54-8fe4-70e5fc8eba17__elsu6i3' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:54:38 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe02057-cbe2-4ad6-8786-cf48c15c84fe]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:38 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD
Sep 22 15:54:38 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:38 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:39 devstack sudo[104334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD
Sep 22 15:54:39 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:39 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] 56346596-58e3-4d54-8fe4-70e5fc8eba17 was raw, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:39 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81
Sep 22 15:54:39 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:39 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81" returned: 0 in 0.431s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_56346596-58e3-4d54-8fe4-70e5fc8eba17_zf0xe09odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:54:39 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Converted 0.00 MB image at 0.00 MB/s
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:39 devstack sudo[104345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 1G
Sep 22 15:54:39 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:39 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 1G" returned: 0 in 0.296s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Downloaded image 56346596-58e3-4d54-8fe4-70e5fc8eba17 ((None, [{'url': 'file:///opt/stack/data/glance/images/56346596-58e3-4d54-8fe4-70e5fc8eba17', 'metadata': {}}])) to volume fe377969-157c-4f2e-8811-e21ed42b5d81 successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Temporary image 56346596-58e3-4d54-8fe4-70e5fc8eba17 for user b6331d4765a74715a30b286aff10fd89 is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Marking volume fe377969-157c-4f2e-8811-e21ed42b5d81 as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Copying metadata from image 56346596-58e3-4d54-8fe4-70e5fc8eba17 to fe377969-157c-4f2e-8811-e21ed42b5d81. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:54:39 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Creating volume glance metadata for volume fe377969-157c-4f2e-8811-e21ed42b5d81 backed by image 56346596-58e3-4d54-8fe4-70e5fc8eba17 with: {'image_id': '56346596-58e3-4d54-8fe4-70e5fc8eba17', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8c0b83cac44f6be5ee243236a3580fa7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aedaf7-0253-4ae7-8c4d-030ac82e33e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe377969-157c-4f2e-8811-e21ed42b5d81', 'volume_size': 1, 'image_id': '56346596-58e3-4d54-8fe4-70e5fc8eba17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56346596-58e3-4d54-8fe4-70e5fc8eba17', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c0b83cac44f6be5ee243236a3580fa7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '009969872d244f74b1ee3a0d4c25a3d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0dd081a5a512c7d06a2d45dd8393500d3056b40324a16b4d23c348063cf26b50f1521f35fef0413242f93e76298ffc12f65ffb3d67e2fa964512f0fcde204a9', 'id': '56346596-58e3-4d54-8fe4-70e5fc8eba17', 'created_at': datetime.datetime(2026, 9, 22, 13, 54, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 54, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56346596-58e3-4d54-8fe4-70e5fc8eba17/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd292abe90>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fc9390-f640-41d8-abc9-9a78fef1f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:40 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Volume volume-fe377969-157c-4f2e-8811-e21ed42b5d81 (fe377969-157c-4f2e-8811-e21ed42b5d81): created successfully
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fc9390-f640-41d8-abc9-9a78fef1f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Flow 'volume_create_manager' (873332b8-f50f-41d5-be46-05ec6c8fa985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8b074694-901e-4b0d-b5a3-dadca36206b4 tempest-VolumeImageDependencyTests-155751482 None] Created volume successfully.
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Acquiring lock "cinder-fe377969-157c-4f2e-8811-e21ed42b5d81-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Lock "cinder-fe377969-157c-4f2e-8811-e21ed42b5d81-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Acquiring lock "cinder-quobyte-fe377969-157c-4f2e-8811-e21ed42b5d81" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Lock "cinder-quobyte-fe377969-157c-4f2e-8811-e21ed42b5d81" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3137e4f-472d-422d-b35f-63cf0b8aa560]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:40 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81
Sep 22 15:54:40 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:41 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81" returned: 0 in 0.350s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:41 devstack sudo[104356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81
Sep 22 15:54:41 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:41 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-fe377969-157c-4f2e-8811-e21ed42b5d81" returned: 0 in 0.234s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Lock "cinder-quobyte-fe377969-157c-4f2e-8811-e21ed42b5d81" released by "delete_volume" :: held 0.624s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Created reservations ['e3f3087f-a5f6-4f2d-8442-221f65406e46', '0b3174d8-0e1b-4a8c-9fbd-2b4cba69cab9', 'a8016391-44c3-41ca-9f31-e7b242a59b40', '5897166b-6271-468b-8c10-150cbdc105f3'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:41 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:41 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:41 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.237s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:41 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Deleted volume successfully.
Sep 22 15:54:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2a0d49a1-5b13-4c4b-a301-23af106b80f2 tempest-VolumeImageDependencyTests-155751482 None] Lock "cinder-fe377969-157c-4f2e-8811-e21ed42b5d81-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Flow 'volume_create_manager' (54f0e574-2d32-4149-b2cc-4645f8cccc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77227bca-9754-472a-baaf-0a5d5a14d652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77227bca-9754-472a-baaf-0a5d5a14d652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017368223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cdd785-7bc7-499e-94e8-28bcb685a7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7048f773a5a84df79bf4345d0e124205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:50Z,use_quota=True,user_id='b7e6cf351f8645588f7bd7e63508067c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd7bfd-43f2-4da2-8f06-3d463b33488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd7bfd-43f2-4da2-8f06-3d463b33488f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c88d9d8-ccb5-47a5-89bb-b0d3f71b7280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c88d9d8-ccb5-47a5-89bb-b0d3f71b7280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cdd785-7bc7-499e-94e8-28bcb685a7e1', 'volume_name': 'volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240824f8-820d-4735-8c80-ba539c1acdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240824f8-820d-4735-8c80-ba539c1acdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e287ba-0b2c-467b-8e9b-d620705447fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:49 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Volume 55cdd785-7bc7-499e-94e8-28bcb685a7e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1', 'volume_size': 1}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017368223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cdd785-7bc7-499e-94e8-28bcb685a7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7048f773a5a84df79bf4345d0e124205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:50Z,use_quota=True,user_id='b7e6cf351f8645588f7bd7e63508067c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Creating volume 55cdd785-7bc7-499e-94e8-28bcb685a7e1 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:49 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:49 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1 1073741824
Sep 22 15:54:49 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:50 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1 1073741824" returned: 0 in 0.417s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:50 devstack sudo[104370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1
Sep 22 15:54:50 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:50 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1" returned: 0 in 0.241s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e287ba-0b2c-467b-8e9b-d620705447fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8470fa7-fe8e-4316-a4f7-f32315602ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:50 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Volume volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1 (55cdd785-7bc7-499e-94e8-28bcb685a7e1): created successfully
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8470fa7-fe8e-4316-a4f7-f32315602ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Flow 'volume_create_manager' (54f0e574-2d32-4149-b2cc-4645f8cccc68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:50 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-16b47080-14c6-42ff-a302-7f37beced6c9 tempest-ProjectReaderTests-1575340460 None] Created volume successfully.
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Acquiring lock "cinder-55cdd785-7bc7-499e-94e8-28bcb685a7e1-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Lock "cinder-55cdd785-7bc7-499e-94e8-28bcb685a7e1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Acquiring lock "cinder-quobyte-55cdd785-7bc7-499e-94e8-28bcb685a7e1" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Lock "cinder-quobyte-55cdd785-7bc7-499e-94e8-28bcb685a7e1" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a20c42-ccf7-49bf-a6f7-7e023a6be3cd]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:51 devstack sudo[104374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1
Sep 22 15:54:51 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:51 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1" returned: 0 in 0.354s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:51 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1
Sep 22 15:54:51 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:51 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-55cdd785-7bc7-499e-94e8-28bcb685a7e1" returned: 0 in 0.249s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Lock "cinder-quobyte-55cdd785-7bc7-499e-94e8-28bcb685a7e1" released by "delete_volume" :: held 0.644s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Created reservations ['5fdeb588-dbf3-41c5-b24a-b2b124c7065e', 'c16a4b30-69ae-4f84-b690-7cbb5d708be4', 'e3b2b008-af61-4560-9671-253ac64da740', 'b00cc07f-c349-49be-83e1-c94d3c199128'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:51 devstack sudo[104382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:51 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:51 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.246s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:51 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Deleted volume successfully.
Sep 22 15:54:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7b0ac764-e3ba-463c-9f70-bc7d3213bc6e tempest-ProjectReaderTests-1575340460 None] Lock "cinder-55cdd785-7bc7-499e-94e8-28bcb685a7e1-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Flow 'volume_create_manager' (c88473c7-12c5-4e50-a4e8-f766f64a046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39649dbe-6bb6-4fad-8de2-398e00e8f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39649dbe-6bb6-4fad-8de2-398e00e8f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-428047759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4873fa73-80bc-4a8b-87cf-a8403bebaf58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7048f773a5a84df79bf4345d0e124205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:52Z,use_quota=True,user_id='b7e6cf351f8645588f7bd7e63508067c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fec0c4-f0bc-47ae-b8bb-cd6fcff7a90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fec0c4-f0bc-47ae-b8bb-cd6fcff7a90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff2d86e-796a-429d-b367-d6ef8e7e0962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff2d86e-796a-429d-b367-d6ef8e7e0962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4873fa73-80bc-4a8b-87cf-a8403bebaf58', 'volume_name': 'volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674d03d7-5c92-4447-8009-4943f0c18122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674d03d7-5c92-4447-8009-4943f0c18122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53bd3a8-688c-4439-a451-cdc0239ceba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:52 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Volume 4873fa73-80bc-4a8b-87cf-a8403bebaf58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58', 'volume_size': 1}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-428047759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4873fa73-80bc-4a8b-87cf-a8403bebaf58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7048f773a5a84df79bf4345d0e124205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:52Z,use_quota=True,user_id='b7e6cf351f8645588f7bd7e63508067c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Creating volume 4873fa73-80bc-4a8b-87cf-a8403bebaf58 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:52 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:52 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58 1073741824
Sep 22 15:54:52 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:52 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58 1073741824" returned: 0 in 0.415s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:52 devstack sudo[104390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58
Sep 22 15:54:52 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:53 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58" returned: 0 in 0.248s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53bd3a8-688c-4439-a451-cdc0239ceba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5afa7d-2439-4277-905b-8b38dcc41c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:53 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Volume volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58 (4873fa73-80bc-4a8b-87cf-a8403bebaf58): created successfully
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5afa7d-2439-4277-905b-8b38dcc41c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Flow 'volume_create_manager' (c88473c7-12c5-4e50-a4e8-f766f64a046a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2ea1dda6-ed9f-46fb-89fc-7d8c4d1a0fb0 tempest-ProjectReaderTests-1575340460 None] Created volume successfully.
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Acquiring lock "cinder-4873fa73-80bc-4a8b-87cf-a8403bebaf58-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Lock "cinder-4873fa73-80bc-4a8b-87cf-a8403bebaf58-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Acquiring lock "cinder-quobyte-4873fa73-80bc-4a8b-87cf-a8403bebaf58" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Lock "cinder-quobyte-4873fa73-80bc-4a8b-87cf-a8403bebaf58" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e0fe4d-290d-4994-a295-f5c3a5ffc970]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:53 devstack sudo[104393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58
Sep 22 15:54:53 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:53 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58" returned: 0 in 0.352s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:53 devstack sudo[104398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58
Sep 22 15:54:53 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:54 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4873fa73-80bc-4a8b-87cf-a8403bebaf58" returned: 0 in 0.245s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Lock "cinder-quobyte-4873fa73-80bc-4a8b-87cf-a8403bebaf58" released by "delete_volume" :: held 0.637s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Created reservations ['9efb98fe-211f-4259-935a-ac5b11ca4367', '98f7482f-d9fa-46dc-bb67-9233ed6af833', '930e1c0a-5a4e-40d8-b17b-88f830740b7b', '6acf0d36-0676-4439-8e36-758361075d3c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:54 devstack sudo[104401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:54 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:54 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.246s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:54 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Deleted volume successfully.
Sep 22 15:54:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-57a2295d-fd9c-4e10-b82a-c3dc6776160c tempest-ProjectReaderTests-1575340460 None] Lock "cinder-4873fa73-80bc-4a8b-87cf-a8403bebaf58-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Flow 'volume_create_manager' (2ecc9c11-a65d-4263-8b73-f098d42f4763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891d4968-b09a-4b15-9d3b-86451a5c0a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891d4968-b09a-4b15-9d3b-86451a5c0a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528769569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effb2660-cf77-4a77-a8a4-e07f5d21e2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7048f773a5a84df79bf4345d0e124205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:55Z,use_quota=True,user_id='b7e6cf351f8645588f7bd7e63508067c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb58889-33ee-4108-806d-81fa31afdd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb58889-33ee-4108-806d-81fa31afdd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fdcc30-7d9b-4fb8-9b25-1fce89404201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fdcc30-7d9b-4fb8-9b25-1fce89404201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'effb2660-cf77-4a77-a8a4-e07f5d21e2b5', 'volume_name': 'volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448574db-e67d-4a90-a2a0-fb260d2d0aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448574db-e67d-4a90-a2a0-fb260d2d0aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b807cbab-a7d4-4da2-8082-2e5ab99be409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:55 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Volume effb2660-cf77-4a77-a8a4-e07f5d21e2b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5', 'volume_size': 1}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528769569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effb2660-cf77-4a77-a8a4-e07f5d21e2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7048f773a5a84df79bf4345d0e124205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:55Z,use_quota=True,user_id='b7e6cf351f8645588f7bd7e63508067c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Creating volume effb2660-cf77-4a77-a8a4-e07f5d21e2b5 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:55 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:55 devstack sudo[104404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5 1073741824
Sep 22 15:54:55 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:55 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5 1073741824" returned: 0 in 0.402s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:55 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5
Sep 22 15:54:55 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:55 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5" returned: 0 in 0.235s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b807cbab-a7d4-4da2-8082-2e5ab99be409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe461c5-1865-4846-b7f7-629824514a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:55 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Volume volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5 (effb2660-cf77-4a77-a8a4-e07f5d21e2b5): created successfully
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe461c5-1865-4846-b7f7-629824514a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Flow 'volume_create_manager' (2ecc9c11-a65d-4263-8b73-f098d42f4763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:55 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9673f653-916f-4d2e-9fc5-322a8be54f01 tempest-ProjectReaderTests-1575340460 None] Created volume successfully.
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Acquiring lock "cinder-effb2660-cf77-4a77-a8a4-e07f5d21e2b5-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Lock "cinder-effb2660-cf77-4a77-a8a4-e07f5d21e2b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Acquiring lock "cinder-quobyte-effb2660-cf77-4a77-a8a4-e07f5d21e2b5" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Lock "cinder-quobyte-effb2660-cf77-4a77-a8a4-e07f5d21e2b5" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e27aab-3d22-412e-a013-be83fc0da072]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:56 devstack sudo[104412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5
Sep 22 15:54:56 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:56 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5" returned: 0 in 0.350s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:56 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5
Sep 22 15:54:56 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:56 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-effb2660-cf77-4a77-a8a4-e07f5d21e2b5" returned: 0 in 0.235s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Lock "cinder-quobyte-effb2660-cf77-4a77-a8a4-e07f5d21e2b5" released by "delete_volume" :: held 0.628s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Created reservations ['90f0400e-48dc-47ba-aefd-5f31a4f0e8c8', 'da6d44a4-5628-49ab-aeb2-dc7ef176c6a7', 'cd51d617-f7f8-4ed3-b4f7-499c8a39df28', 'b16904c6-5b9b-4f37-814c-3a0f8ea1f5c4'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:56 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:56 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:57 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.256s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:57 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Deleted volume successfully.
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d7204f3f-632e-4ebc-823b-3900487c538d tempest-ProjectReaderTests-1575340460 None] Lock "cinder-effb2660-cf77-4a77-a8a4-e07f5d21e2b5-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Flow 'volume_create_manager' (5f5bcbc5-4ed1-4a56-ab1f-65de22dba601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0fc693-096b-4fe3-8ade-bde8a87feda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0fc693-096b-4fe3-8ade-bde8a87feda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666834083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79c295c-3eb8-41a0-b639-d1f847252f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7048f773a5a84df79bf4345d0e124205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:58Z,use_quota=True,user_id='b7e6cf351f8645588f7bd7e63508067c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d6356c-2b10-49c7-ab35-27ec6c44b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d6356c-2b10-49c7-ab35-27ec6c44b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ac2d42-e36a-45b6-b45f-864f32b3f0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ac2d42-e36a-45b6-b45f-864f32b3f0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79c295c-3eb8-41a0-b639-d1f847252f59', 'volume_name': 'volume-c79c295c-3eb8-41a0-b639-d1f847252f59', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb208ae-164a-4f90-929d-6b4a38475840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb208ae-164a-4f90-929d-6b4a38475840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65350d6c-1842-4295-a994-2364ed264eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:57 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Volume c79c295c-3eb8-41a0-b639-d1f847252f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79c295c-3eb8-41a0-b639-d1f847252f59', 'volume_size': 1}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666834083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79c295c-3eb8-41a0-b639-d1f847252f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7048f773a5a84df79bf4345d0e124205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:54:58Z,use_quota=True,user_id='b7e6cf351f8645588f7bd7e63508067c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Creating volume c79c295c-3eb8-41a0-b639-d1f847252f59 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:54:57 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:54:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:57 devstack sudo[104423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59 1073741824
Sep 22 15:54:57 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:58 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59 1073741824" returned: 0 in 0.441s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:58 devstack sudo[104429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59
Sep 22 15:54:58 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:58 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59" returned: 0 in 0.238s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65350d6c-1842-4295-a994-2364ed264eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79c295c-3eb8-41a0-b639-d1f847252f59', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4f19dc-0930-440d-bcdd-8cc167294c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:54:58 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Volume volume-c79c295c-3eb8-41a0-b639-d1f847252f59 (c79c295c-3eb8-41a0-b639-d1f847252f59): created successfully
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4f19dc-0930-440d-bcdd-8cc167294c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Flow 'volume_create_manager' (5f5bcbc5-4ed1-4a56-ab1f-65de22dba601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:54:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-57459ad2-a508-4a9d-a5ff-fad3bf0c4225 tempest-ProjectReaderTests-1575340460 None] Created volume successfully.
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Acquiring lock "cinder-c79c295c-3eb8-41a0-b639-d1f847252f59-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Lock "cinder-c79c295c-3eb8-41a0-b639-d1f847252f59-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Acquiring lock "cinder-quobyte-c79c295c-3eb8-41a0-b639-d1f847252f59" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Lock "cinder-quobyte-c79c295c-3eb8-41a0-b639-d1f847252f59" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0700c1d-97e0-4964-97b5-c9f0f6dafcab]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:54:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:58 devstack sudo[104432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59
Sep 22 15:54:58 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:59 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59" returned: 0 in 0.362s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:59 devstack sudo[104437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59
Sep 22 15:54:59 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:59 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c79c295c-3eb8-41a0-b639-d1f847252f59" returned: 0 in 0.254s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Lock "cinder-quobyte-c79c295c-3eb8-41a0-b639-d1f847252f59" released by "delete_volume" :: held 0.660s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Created reservations ['13e4b7bb-b673-4397-a8de-299e981f9922', '3d41ddea-16e6-4669-9e20-b1a1df5e6485', '3112987c-fa84-425a-b594-efcfb0eb77d5', '3dbdce6f-87ac-40c8-90a7-72dcddaa7864'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:54:59 devstack sudo[104440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:54:59 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:54:59 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.242s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:54:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Deleted volume successfully.
Sep 22 15:54:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e2adc431-4825-4c2a-80cd-ba54c48691cb tempest-ProjectReaderTests-1575340460 None] Lock "cinder-c79c295c-3eb8-41a0-b639-d1f847252f59-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:09 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=113,cinder:SELECT=70,cinder:INSERT=34,cinder:DELETE=14 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:55:09 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=81,cinder:UPDATE=110,cinder:DELETE=6,cinder:INSERT=25 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (cb1f95ec-1b61-4ae3-9cb0-a75f4a5c5521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3a25c2-65d9-4c5e-98f7-d6bee052e5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3a25c2-65d9-4c5e-98f7-d6bee052e5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2063129279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a0f2e0-6185-433b-839b-fd726a23d7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:12Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c242ec4e-218e-4b2b-b2dc-a04de93cab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c242ec4e-218e-4b2b-b2dc-a04de93cab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ebcb74-2711-4879-be13-1ffc3db18be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ebcb74-2711-4879-be13-1ffc3db18be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a0f2e0-6185-433b-839b-fd726a23d7a7', 'volume_name': 'volume-40a0f2e0-6185-433b-839b-fd726a23d7a7', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dd3b8b-4c85-48c3-8cf9-11d84558663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dd3b8b-4c85-48c3-8cf9-11d84558663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d96684-cf45-4b1e-9372-7f47da65d268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:11 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume 40a0f2e0-6185-433b-839b-fd726a23d7a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a0f2e0-6185-433b-839b-fd726a23d7a7', 'volume_size': 1}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2063129279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a0f2e0-6185-433b-839b-fd726a23d7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:12Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Creating volume 40a0f2e0-6185-433b-839b-fd726a23d7a7 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:11 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:11 devstack sudo[104814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 1073741824
Sep 22 15:55:11 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (df582036-2a51-46d1-bb38-89f01258c7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ddf1c5-d6bf-4444-bf97-30b7c0052da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ddf1c5-d6bf-4444-bf97-30b7c0052da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1530354042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b2e4e7-d4d9-45f8-bf6c-c132861dff91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:12Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca6ddfb-a15d-45d2-a3a9-65e0d2c880ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca6ddfb-a15d-45d2-a3a9-65e0d2c880ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce12c529-f163-448e-82dd-ed48a88731a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce12c529-f163-448e-82dd-ed48a88731a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b2e4e7-d4d9-45f8-bf6c-c132861dff91', 'volume_name': 'volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65a487c-7b34-4313-9dcb-96a2b8ecf1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65a487c-7b34-4313-9dcb-96a2b8ecf1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023d6359-2c73-4256-b489-c19ddfaaf999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Volume f4b2e4e7-d4d9-45f8-bf6c-c132861dff91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91', 'volume_size': 1}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:12 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 1073741824" returned: 0 in 0.750s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:12 devstack sudo[104893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7
Sep 22 15:55:12 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Flow 'volume_create_manager' (1d5f90b2-a857-439f-b9ac-3fe2defb3805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa96489-a3fa-46aa-8d11-f9ca651c4ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa96489-a3fa-46aa-8d11-f9ca651c4ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-991322254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1c8e57-a0e5-47c9-8d3e-a387cef464b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99f3abe870041f29f22572724484df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:13Z,use_quota=True,user_id='b37a83d0ce604c62957d75ff09f41346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e2f8ff-45bd-47f5-914f-aa4b5cfeba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e2f8ff-45bd-47f5-914f-aa4b5cfeba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b270b79-e4da-40d9-ba23-53afc6d80009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b270b79-e4da-40d9-ba23-53afc6d80009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1c8e57-a0e5-47c9-8d3e-a387cef464b7', 'volume_name': 'volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1f840d-1de8-46e3-846f-77cd955e3875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1f840d-1de8-46e3-846f-77cd955e3875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22971bd-fc09-493a-bdde-0aca9d3624f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:12 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Volume ab1c8e57-a0e5-47c9-8d3e-a387cef464b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7', 'volume_size': 1}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:12 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7" returned: 0 in 0.456s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1530354042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b2e4e7-d4d9-45f8-bf6c-c132861dff91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:12Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Creating volume f4b2e4e7-d4d9-45f8-bf6c-c132861dff91 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:13 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:13 devstack sudo[104946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91 1073741824
Sep 22 15:55:13 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (d8650da4-89e8-4d65-a9cf-bb34afa6f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c6e573-dd09-4f17-8f75-4d5c01a49beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d96684-cf45-4b1e-9372-7f47da65d268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a0f2e0-6185-433b-839b-fd726a23d7a7', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e874a162-ccb2-424a-be61-482d12f2fbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c6e573-dd09-4f17-8f75-4d5c01a49beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-794386885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2449c526-f93c-4b28-afd7-25713ffcb2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:13Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b83d7c-2075-49a7-83f9-e654ee87322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b83d7c-2075-49a7-83f9-e654ee87322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32176a6b-c65e-4abf-a972-5925bdc5cca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32176a6b-c65e-4abf-a972-5925bdc5cca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2449c526-f93c-4b28-afd7-25713ffcb2f9', 'volume_name': 'volume-2449c526-f93c-4b28-afd7-25713ffcb2f9', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b233cbd5-6775-4c03-88dd-efc05b0fa2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b233cbd5-6775-4c03-88dd-efc05b0fa2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf697e5-e4ef-41d1-b09b-778bf638b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Volume 2449c526-f93c-4b28-afd7-25713ffcb2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2449c526-f93c-4b28-afd7-25713ffcb2f9', 'volume_size': 1}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 (40a0f2e0-6185-433b-839b-fd726a23d7a7): created successfully
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e874a162-ccb2-424a-be61-482d12f2fbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (cb1f95ec-1b61-4ae3-9cb0-a75f4a5c5521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:13 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-581fbfe3-b040-4f94-9605-aa7cbbcfcdd3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created volume successfully.
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (b4834d53-b474-4088-bf9e-0d579de6a012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d554c81c-76cc-423c-8c19-72c087fd7db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d554c81c-76cc-423c-8c19-72c087fd7db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834245970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c18aeb1-5242-41fa-adec-8e9d5cad956e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:13Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0382a565-d420-4eba-8c7f-df3832dc0d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0382a565-d420-4eba-8c7f-df3832dc0d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6ba3f1-1379-47fe-9713-b25c0b13679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6ba3f1-1379-47fe-9713-b25c0b13679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c18aeb1-5242-41fa-adec-8e9d5cad956e', 'volume_name': 'volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7efd3f-4a7b-40b8-b67f-775a992b3e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7efd3f-4a7b-40b8-b67f-775a992b3e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e35a9e-fb69-4bb3-b617-3af9a9bbcf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Volume 0c18aeb1-5242-41fa-adec-8e9d5cad956e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e', 'volume_size': 1}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91 1073741824" returned: 0 in 0.573s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:13 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91
Sep 22 15:55:13 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (512242ce-ab1e-4eff-ba99-0061eb7df79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beca6097-147b-49ef-9d27-316e291fb443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beca6097-147b-49ef-9d27-316e291fb443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-124648130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f57037-1382-40de-b60b-967d7353704b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:14Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad664023-e95a-479e-ab46-a24516d9d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad664023-e95a-479e-ab46-a24516d9d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a76e3f-161e-4f38-9bfa-bd8c8f9fbfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a76e3f-161e-4f38-9bfa-bd8c8f9fbfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f57037-1382-40de-b60b-967d7353704b', 'volume_name': 'volume-26f57037-1382-40de-b60b-967d7353704b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f6581b-d43f-4b51-b335-c06b8c26df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f6581b-d43f-4b51-b335-c06b8c26df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a35e9c-5b5d-45b7-9bc9-5b843e27bc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:13 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Volume 26f57037-1382-40de-b60b-967d7353704b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f57037-1382-40de-b60b-967d7353704b', 'volume_size': 1}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:13 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91" returned: 0 in 0.371s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-991322254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1c8e57-a0e5-47c9-8d3e-a387cef464b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99f3abe870041f29f22572724484df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:13Z,use_quota=True,user_id='b37a83d0ce604c62957d75ff09f41346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Creating volume ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:14 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023d6359-2c73-4256-b489-c19ddfaaf999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6de710-68c1-4290-9feb-8f5f02f83bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:14 devstack sudo[104955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 1073741824
Sep 22 15:55:14 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:14 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Volume volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91 (f4b2e4e7-d4d9-45f8-bf6c-c132861dff91): created successfully
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6de710-68c1-4290-9feb-8f5f02f83bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (df582036-2a51-46d1-bb38-89f01258c7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-04ec1c81-923d-461d-a064-9808c14b7981 tempest-CreateVolumesFromImageTest-1877646247 None] Created volume successfully.
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (7439077c-5d4c-4b14-9616-863477165320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82eb8645-73e6-472e-8f2a-4ceddd7d399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82eb8645-73e6-472e-8f2a-4ceddd7d399c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807491003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba44e22-ce88-4bd0-86fe-fd0fa71363bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:14Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999a7a54-117f-4064-8920-c714d3ed4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999a7a54-117f-4064-8920-c714d3ed4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90780ceb-756a-47b8-82fe-babbf4ed279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90780ceb-756a-47b8-82fe-babbf4ed279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ba44e22-ce88-4bd0-86fe-fd0fa71363bd', 'volume_name': 'volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887b3420-a77f-4cfb-829d-ad69226e0581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887b3420-a77f-4cfb-829d-ad69226e0581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01c2ddb-87a2-4d6a-aefe-52936c419f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:14 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Volume 7ba44e22-ce88-4bd0-86fe-fd0fa71363bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd', 'volume_size': 1}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:14 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 1073741824" returned: 0 in 0.666s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:14 devstack sudo[104961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7
Sep 22 15:55:14 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:14 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" returned: 0 in 0.266s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-794386885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2449c526-f93c-4b28-afd7-25713ffcb2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:13Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Creating volume 2449c526-f93c-4b28-afd7-25713ffcb2f9 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:14 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22971bd-fc09-493a-bdde-0aca9d3624f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:15 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9 1073741824
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb08327-3e65-4340-b90d-3d96b9038ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:15 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:15 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Volume volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 (ab1c8e57-a0e5-47c9-8d3e-a387cef464b7): created successfully
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb08327-3e65-4340-b90d-3d96b9038ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Flow 'volume_create_manager' (1d5f90b2-a857-439f-b9ac-3fe2defb3805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e9f1fe9b-a91a-4188-a2e3-62fddf438125 tempest-VolumeDependencyTests-1473029914 None] Created volume successfully.
Sep 22 15:55:15 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9 1073741824" returned: 0 in 0.478s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:15 devstack sudo[104970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9
Sep 22 15:55:15 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:15 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9" returned: 0 in 0.282s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.202s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834245970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c18aeb1-5242-41fa-adec-8e9d5cad956e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:13Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Creating volume 0c18aeb1-5242-41fa-adec-8e9d5cad956e {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:15 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:15 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e 1073741824
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf697e5-e4ef-41d1-b09b-778bf638b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2449c526-f93c-4b28-afd7-25713ffcb2f9', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:15 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51dc3be-9faa-4152-aae7-342c2bf77eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:15 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Volume volume-2449c526-f93c-4b28-afd7-25713ffcb2f9 (2449c526-f93c-4b28-afd7-25713ffcb2f9): created successfully
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51dc3be-9faa-4152-aae7-342c2bf77eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (d8650da4-89e8-4d65-a9cf-bb34afa6f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:15 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3a6e9a42-0961-430c-9ae8-5eea766d283e tempest-CreateVolumesFromImageTest-1877646247 None] Created volume successfully.
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:16 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e 1073741824" returned: 0 in 0.506s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:16 devstack sudo[104979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e
Sep 22 15:55:16 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:16 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e" returned: 0 in 0.307s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.697s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-124648130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f57037-1382-40de-b60b-967d7353704b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:14Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Creating volume 26f57037-1382-40de-b60b-967d7353704b {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:16 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:16 devstack sudo[104982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b 1073741824
Sep 22 15:55:16 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e35a9e-fb69-4bb3-b617-3af9a9bbcf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041fd586-8993-4b58-a198-4bce2909ccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:16 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Volume volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e (0c18aeb1-5242-41fa-adec-8e9d5cad956e): created successfully
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041fd586-8993-4b58-a198-4bce2909ccac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (b4834d53-b474-4088-bf9e-0d579de6a012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Flow 'volume_create_manager' (a3c2346a-889b-4d98-8e10-f9d78a6f2ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccb61e1-d8be-45de-9be4-34bd935a0c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-79b4f30c-7259-4a31-a34b-48a480cd634d tempest-CreateVolumesFromImageTest-1877646247 None] Created volume successfully.
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccb61e1-d8be-45de-9be4-34bd935a0c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd4b038-af04-4d71-9a91-afb78c9a64eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d1b0bc60994373b664f1f990705815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:17Z,use_quota=True,user_id='7699c518e7874e2294b6749e2ad7ed09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eecb8c6b-8053-408b-95df-958c72e636b0),volume_type_id=eecb8c6b-8053-408b-95df-958c72e636b0)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c5ace3-3a5d-4c95-a80d-8081e3baee4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c5ace3-3a5d-4c95-a80d-8081e3baee4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119119d7-5f81-4ccb-9364-931f89173c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:16 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119119d7-5f81-4ccb-9364-931f89173c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bd4b038-af04-4d71-9a91-afb78c9a64eb', 'volume_name': 'volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb', 'volume_size': 1, 'image_id': '1b48bcee-a44a-406d-a59e-1bf48b53db24', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b48bcee-a44a-406d-a59e-1bf48b53db24', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e144229a6e6105bec3b4e007bef56de0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93d1b0bc60994373b664f1f990705815', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9419f70e4bfe3c3ac9c3f42e4fbce86a3c101cf841f4ecc7b24aeb3737d16ef6cb59344db4e840b354d3c6cf49c95c940b489b5459dab9169da61aed579bb740', 'id': '1b48bcee-a44a-406d-a59e-1bf48b53db24', 'created_at': datetime.datetime(2026, 9, 22, 13, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b48bcee-a44a-406d-a59e-1bf48b53db24/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd33778350>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d32f847-8aba-4891-8ff8-11278ce74b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d32f847-8aba-4891-8ff8-11278ce74b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec23377-d7a4-4b22-bf51-834cf1e9b8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:17 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Volume 9bd4b038-af04-4d71-9a91-afb78c9a64eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb', 'volume_size': 1, 'image_id': '1b48bcee-a44a-406d-a59e-1bf48b53db24', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b48bcee-a44a-406d-a59e-1bf48b53db24', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e144229a6e6105bec3b4e007bef56de0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93d1b0bc60994373b664f1f990705815', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9419f70e4bfe3c3ac9c3f42e4fbce86a3c101cf841f4ecc7b24aeb3737d16ef6cb59344db4e840b354d3c6cf49c95c940b489b5459dab9169da61aed579bb740', 'id': '1b48bcee-a44a-406d-a59e-1bf48b53db24', 'created_at': datetime.datetime(2026, 9, 22, 13, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b48bcee-a44a-406d-a59e-1bf48b53db24/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd33778350>}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Trying to clone 9bd4b038-af04-4d71-9a91-afb78c9a64eb from image 1b48bcee-a44a-406d-a59e-1bf48b53db24 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b48bcee-a44a-406d-a59e-1bf48b53db24', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:55:17 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b 1073741824" returned: 0 in 0.494s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:55:17 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Image download 0.00 MB at 0.00 MB/s
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:17 devstack sudo[104988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b
Sep 22 15:55:17 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaeef93-91c3-4ea4-880e-d737f2d3bdda]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:17 devstack sudo[104990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD
Sep 22 15:55:17 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:17 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b" returned: 0 in 0.270s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.977s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807491003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba44e22-ce88-4bd0-86fe-fd0fa71363bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b899a4c280e407b94f035b5eac8c665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:14Z,use_quota=True,user_id='df05162da6fa484da3bc46d5604ec409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Creating volume 7ba44e22-ce88-4bd0-86fe-fd0fa71363bd {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:17 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a35e9c-5b5d-45b7-9bc9-5b843e27bc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f57037-1382-40de-b60b-967d7353704b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:17 devstack sudo[104993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd 1073741824
Sep 22 15:55:17 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0ef36b-cf19-4a2d-a705-2f4f49af2670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:17 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Volume volume-26f57037-1382-40de-b60b-967d7353704b (26f57037-1382-40de-b60b-967d7353704b): created successfully
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0ef36b-cf19-4a2d-a705-2f4f49af2670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (512242ce-ab1e-4eff-ba99-0061eb7df79d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-24e92a62-9dac-4d75-8d13-804800ceb84c tempest-CreateVolumesFromImageTest-1877646247 None] Created volume successfully.
Sep 22 15:55:17 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:17 devstack sudo[104997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD
Sep 22 15:55:17 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:17 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd 1073741824" returned: 0 in 0.505s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:17 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Temporary image 1b48bcee-a44a-406d-a59e-1bf48b53db24 is fetched for user 7699c518e7874e2294b6749e2ad7ed09. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:18 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd
Sep 22 15:55:18 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a152cd2-1b48-4a5d-ba76-53c02b64a1f5]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:18 devstack sudo[105007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD
Sep 22 15:55:18 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:18 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd" returned: 0 in 0.252s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.735s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01c2ddb-87a2-4d6a-aefe-52936c419f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f82005-4a66-4b44-b979-db7795d1f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Creating offline snapshot 3a3574af-1f0e-4591-8911-05626a52a0aa of volume 40a0f2e0-6185-433b-839b-fd726a23d7a7 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:55:18 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Volume volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd (7ba44e22-ce88-4bd0-86fe-fd0fa71363bd): created successfully
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f82005-4a66-4b44-b979-db7795d1f368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Flow 'volume_create_manager' (7439077c-5d4c-4b14-9616-863477165320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b33c128-a3fd-4f18-8acb-751c50f183b0]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f4dc6dde-cb01-47d6-a1e6-36decb040496 tempest-CreateVolumesFromImageTest-1877646247 None] Created volume successfully.
Sep 22 15:55:18 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:18 devstack sudo[105010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7
Sep 22 15:55:18 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:18 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD
Sep 22 15:55:18 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:18 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7" returned: 0 in 0.401s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:18 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:18 devstack sudo[105022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa 1G
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:18 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-quobyte-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5629b18-7336-435c-9619-c74634f5fe21]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:19 devstack sudo[105024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd
Sep 22 15:55:19 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:19 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa 1G" returned: 0 in 0.449s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:19 devstack sudo[105029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa
Sep 22 15:55:19 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:19 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd" returned: 0 in 0.390s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:19 devstack sudo[105034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd
Sep 22 15:55:19 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:19 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa" returned: 0 in 0.300s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:19 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa is being set with open permissions: ugo+rw
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:19 devstack sudo[105039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa
Sep 22 15:55:19 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:19 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd" returned: 0 in 0.259s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd" released by "delete_volume" :: held 0.697s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Created reservations ['a177f785-bdec-4926-abff-28f514688225', '9a365911-42f5-47c5-9fb0-2b65e9fc8b97', '0ca8db84-1d1a-42e9-b763-f627d54c1bfe', '4152f9ee-9586-4295-8e67-8331343904c6'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:19 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa" returned: 0 in 0.278s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:19 devstack sudo[105043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:19 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:19 devstack sudo[105045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.info
Sep 22 15:55:19 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-26f57037-1382-40de-b60b-967d7353704b-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-26f57037-1382-40de-b60b-967d7353704b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:20 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.275s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Deleted volume successfully.
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-quobyte-26f57037-1382-40de-b60b-967d7353704b" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7e2d5048-dc04-4d2e-912d-1cd014d94c4f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-7ba44e22-ce88-4bd0-86fe-fd0fa71363bd-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-26f57037-1382-40de-b60b-967d7353704b" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:20 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.info" returned: 0 in 0.352s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:20 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.info is being set with open permissions: ugo+rw
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b7d2c8-3fe1-487e-a1a3-82d4783fb960]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:20 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.info
Sep 22 15:55:20 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:20 devstack sudo[105050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b
Sep 22 15:55:20 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:20 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.info" returned: 0 in 0.252s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.326s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Creating offline snapshot a7eaed8b-ff2f-434d-8efa-969a2374c39a of volume ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:55:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-917cecaa-15c8-4fb5-ad75-8b435a434394 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Create snapshot completed successfully
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b71c75-b2cd-4245-a66c-277fcf6e2440]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:20 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b" returned: 0 in 0.415s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:20 devstack sudo[105055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7
Sep 22 15:55:20 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:20 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b
Sep 22 15:55:20 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:20 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-26f57037-1382-40de-b60b-967d7353704b" returned: 0 in 0.284s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:20 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-26f57037-1382-40de-b60b-967d7353704b" released by "delete_volume" :: held 0.769s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" returned: 0 in 0.418s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:20 devstack sudo[105067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a 1G
Sep 22 15:55:20 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Created reservations ['5ff2ae52-41c7-4030-b28f-0716d1dde61c', '8f899406-fdcb-4bcd-8208-e3a616a11758', 'd652f429-89ed-4b43-8dc8-0408f382a1ec', 'b7dff8f3-26ea-45bb-a442-a0d041f0f9fa'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:21 devstack sudo[105069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:21 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-0c18aeb1-5242-41fa-adec-8e9d5cad956e-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-0c18aeb1-5242-41fa-adec-8e9d5cad956e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-quobyte-0c18aeb1-5242-41fa-adec-8e9d5cad956e" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (89c121a4-4430-4dbd-8789-c080e4a5c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ae2f0c-b4c3-485a-8b4a-5168fe567ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-0c18aeb1-5242-41fa-adec-8e9d5cad956e" acquired by "delete_volume" :: waited 0.106s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:21 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.428s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Deleted volume successfully.
Sep 22 15:55:21 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ae2f0c-b4c3-485a-8b4a-5168fe567ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398517202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c3c032-b98c-4530-acf8-c119fda7ae65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:21Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb3953e-8aca-4a4c-881c-59cee9ec170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb3953e-8aca-4a4c-881c-59cee9ec170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3ed107-3365-498a-a236-4309161b49d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3ed107-3365-498a-a236-4309161b49d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c3c032-b98c-4530-acf8-c119fda7ae65', 'volume_name': 'volume-14c3c032-b98c-4530-acf8-c119fda7ae65', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6148ad-cb1a-40c9-9318-28fd6ad204c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6148ad-cb1a-40c9-9318-28fd6ad204c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300aaff9-5a33-4a82-9fdf-9dffd4bca9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume 14c3c032-b98c-4530-acf8-c119fda7ae65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c3c032-b98c-4530-acf8-c119fda7ae65', 'volume_size': 1}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[81edaea3-73d0-43ed-af96-8fa635482b77]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a 1G" returned: 0 in 0.745s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-fd5fce3d-b544-4db9-ac00-c89757a13ab4 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-26f57037-1382-40de-b60b-967d7353704b-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:21 devstack sudo[105077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a
Sep 22 15:55:21 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:21 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e
Sep 22 15:55:21 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (91c7f704-e81f-445a-99f6-155d766fa024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1705a33c-a9d0-4d41-ac08-6d42cd15593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1705a33c-a9d0-4d41-ac08-6d42cd15593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1519015931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f47b6c-8f3c-443c-822a-1d19964e7b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:22Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4962cd-1c1e-4542-828b-5aa45a07e608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4962cd-1c1e-4542-828b-5aa45a07e608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8cd898-9084-4982-9fa8-5c6c1b2647da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8cd898-9084-4982-9fa8-5c6c1b2647da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f47b6c-8f3c-443c-822a-1d19964e7b6b', 'volume_name': 'volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dd4baf-2a60-4868-a759-82552d6b8d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dd4baf-2a60-4868-a759-82552d6b8d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1da7f7-8063-4fe0-8af1-08cb27f02407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume a1f47b6c-8f3c-443c-822a-1d19964e7b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b', 'volume_size': 1}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:22 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a" returned: 0 in 0.409s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:22 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a is being set with open permissions: ugo+rw
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:22 devstack sudo[105086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a
Sep 22 15:55:22 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:22 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e" returned: 0 in 0.518s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:22 devstack sudo[105089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e
Sep 22 15:55:22 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (7df27af6-59f8-4fb2-bf8c-7aa6b98806da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8991f09a-58ce-49e2-930b-6fdbc7e0336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a" returned: 0 in 0.307s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8991f09a-58ce-49e2-930b-6fdbc7e0336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859249830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ead99d-da3a-4316-b630-24ab4a1ac416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:22Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674a0c9-01fe-4389-8ad9-af6412ccad65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674a0c9-01fe-4389-8ad9-af6412ccad65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa20de85-647a-41c4-98d0-f19deb7530e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa20de85-647a-41c4-98d0-f19deb7530e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ead99d-da3a-4316-b630-24ab4a1ac416', 'volume_name': 'volume-07ead99d-da3a-4316-b630-24ab4a1ac416', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578a9c57-116f-471e-9274-8dcad5aadc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578a9c57-116f-471e-9274-8dcad5aadc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94c0fc2-f701-47ea-91db-58f6c0fc24cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:22 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume 07ead99d-da3a-4316-b630-24ab4a1ac416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ead99d-da3a-4316-b630-24ab4a1ac416', 'volume_size': 1}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:22 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-0c18aeb1-5242-41fa-adec-8e9d5cad956e" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-0c18aeb1-5242-41fa-adec-8e9d5cad956e" released by "delete_volume" :: held 0.955s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:22 devstack sudo[105093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.info
Sep 22 15:55:22 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Created reservations ['bb7ebe17-c316-4b1c-8076-9b1428248bb7', '003c0b1b-12e2-43b0-a08d-92c70848dff9', '891976ec-6a43-478b-a3ac-5cec18185757', '36add4dc-9c5f-4ad6-ac52-021862d819d3'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:22 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:22 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:22 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.info" returned: 0 in 0.345s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:22 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.info is being set with open permissions: ugo+rw
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:22 devstack sudo[105104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.info
Sep 22 15:55:22 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (c959c527-8d58-4d4a-aead-5497fe71d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50a8579-901d-4826-bda3-211d1779e5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50a8579-901d-4826-bda3-211d1779e5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-11924398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7492dab5-cefd-401a-9277-999247c61ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:23Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6232708-47ba-43b0-91c5-32fccc13aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6232708-47ba-43b0-91c5-32fccc13aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b0a58f-685c-45bf-91d9-89be152be727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b0a58f-685c-45bf-91d9-89be152be727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7492dab5-cefd-401a-9277-999247c61ae4', 'volume_name': 'volume-7492dab5-cefd-401a-9277-999247c61ae4', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f3f561-1e50-47a8-8b93-4ed879b937de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f3f561-1e50-47a8-8b93-4ed879b937de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfad5166-4df7-4f36-adf6-1deef25f1f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume 7492dab5-cefd-401a-9277-999247c61ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7492dab5-cefd-401a-9277-999247c61ae4', 'volume_size': 1}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:23 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.361s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Deleted volume successfully.
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b641c470-7860-4e2e-b4cd-f4baaa0f527e tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-0c18aeb1-5242-41fa-adec-8e9d5cad956e-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:23 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.info" returned: 0 in 0.371s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.796s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.495s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd4b038-af04-4d71-9a91-afb78c9a64eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d1b0bc60994373b664f1f990705815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:17Z,use_quota=True,user_id='7699c518e7874e2294b6749e2ad7ed09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eecb8c6b-8053-408b-95df-958c72e636b0),volume_type_id=eecb8c6b-8053-408b-95df-958c72e636b0)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Creating volume 9bd4b038-af04-4d71-9a91-afb78c9a64eb {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:23 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:23 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb 1073741824
Sep 22 15:55:23 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-10c5b2fd-a1df-4027-bc03-cb188dfcf947 tempest-VolumeDependencyTests-1473029914 None] Create snapshot completed successfully
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (0b142bdd-859c-47d4-8400-6e83c9dcb031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d567397-689d-4807-a36b-4f8d2e8d1210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d567397-689d-4807-a36b-4f8d2e8d1210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1537350191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39dcf56-6cb0-4ebb-b531-4663303242c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:23Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca7b719-8375-4fc6-9d55-94d9cf119951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca7b719-8375-4fc6-9d55-94d9cf119951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f85f10-d4e0-4468-9911-69a77f896112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f85f10-d4e0-4468-9911-69a77f896112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39dcf56-6cb0-4ebb-b531-4663303242c8', 'volume_name': 'volume-b39dcf56-6cb0-4ebb-b531-4663303242c8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d5db08-9d82-4d68-b87c-eccb7a48c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d5db08-9d82-4d68-b87c-eccb7a48c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d8a794-322b-425c-a83f-93361a628292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:23 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume b39dcf56-6cb0-4ebb-b531-4663303242c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39dcf56-6cb0-4ebb-b531-4663303242c8', 'volume_size': 1}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-2449c526-f93c-4b28-afd7-25713ffcb2f9-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-2449c526-f93c-4b28-afd7-25713ffcb2f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:23 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb 1073741824" returned: 0 in 0.488s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-quobyte-2449c526-f93c-4b28-afd7-25713ffcb2f9" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-2449c526-f93c-4b28-afd7-25713ffcb2f9" acquired by "delete_volume" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:23 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb
Sep 22 15:55:23 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a59131-3cc5-45ea-890a-d9eb96b2d775]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:24 devstack sudo[105116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9
Sep 22 15:55:24 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:24 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb" returned: 0 in 0.304s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.466s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398517202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c3c032-b98c-4530-acf8-c119fda7ae65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:21Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Creating volume 14c3c032-b98c-4530-acf8-c119fda7ae65 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:24 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:24 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65 1073741824
Sep 22 15:55:24 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Attempting download of 1b48bcee-a44a-406d-a59e-1bf48b53db24 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b48bcee-a44a-406d-a59e-1bf48b53db24', 'metadata': {}}])) to volume 9bd4b038-af04-4d71-9a91-afb78c9a64eb. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Flow 'volume_create_manager' (11f9105e-2c54-4468-b2bd-0637b4984f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baa8e0c-d06f-4f29-84e7-8468dbe45542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2e90e7-d8ed-4ab4-98bf-83ce48a7ffa1]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b48bcee-a44a-406d-a59e-1bf48b53db24_boud4uq9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baa8e0c-d06f-4f29-84e7-8468dbe45542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-516210126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90c94d4-a3ba-4862-a7f8-50863b4f2a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99f3abe870041f29f22572724484df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a7eaed8b-ff2f-434d-8efa-969a2374c39a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:24Z,use_quota=True,user_id='b37a83d0ce604c62957d75ff09f41346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:24 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba62771-086c-4bdf-a9b8-1b73c7b0f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba62771-086c-4bdf-a9b8-1b73c7b0f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb34582-ea6f-4014-a5c2-9680051ea9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb34582-ea6f-4014-a5c2-9680051ea9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd90c94d4-a3ba-4862-a7f8-50863b4f2a60', 'volume_name': 'volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60', 'volume_size': 1, 'snapshot_id': 'a7eaed8b-ff2f-434d-8efa-969a2374c39a'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2222e75a-5801-45a3-ae34-9d5288a3efdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2222e75a-5801-45a3-ae34-9d5288a3efdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c34460-c8f6-42de-a41f-52516b950091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:24 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Volume d90c94d4-a3ba-4862-a7f8-50863b4f2a60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60', 'volume_size': 1, 'snapshot_id': 'a7eaed8b-ff2f-434d-8efa-969a2374c39a'}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9" returned: 0 in 0.512s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:24 devstack sudo[105126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9
Sep 22 15:55:24 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:24 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b48bcee-a44a-406d-a59e-1bf48b53db24_boud4uq9
Sep 22 15:55:24 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:24 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65 1073741824" returned: 0 in 0.499s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:24 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:24 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-2449c526-f93c-4b28-afd7-25713ffcb2f9" returned: 0 in 0.297s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b48bcee-a44a-406d-a59e-1bf48b53db24_boud4uq9" returned: 0 in 0.385s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b48bcee-a44a-406d-a59e-1bf48b53db24_boud4uq9 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:24 devstack sudo[105135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65
Sep 22 15:55:24 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-2449c526-f93c-4b28-afd7-25713ffcb2f9" released by "delete_volume" :: held 0.879s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Created reservations ['e3a2b509-1d02-4de0-abc8-65197a75ad6a', '944f4ecb-9c5a-4cda-924f-5b4b06769f75', 'efadd6c4-df78-4232-a81d-7f274e3ea1c4', '948fe2f6-7380-453f-8103-da7962d99ecf'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:24 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b48bcee-a44a-406d-a59e-1bf48b53db24_boud4uq9
Sep 22 15:55:24 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:24 devstack sudo[105139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:24 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:25 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65" returned: 0 in 0.299s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.930s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1519015931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f47b6c-8f3c-443c-822a-1d19964e7b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:22Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Creating volume a1f47b6c-8f3c-443c-822a-1d19964e7b6b {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:25 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300aaff9-5a33-4a82-9fdf-9dffd4bca9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c3c032-b98c-4530-acf8-c119fda7ae65', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71cabdb-a2f5-4ff9-8c45-5dd2d40046c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:25 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume volume-14c3c032-b98c-4530-acf8-c119fda7ae65 (14c3c032-b98c-4530-acf8-c119fda7ae65): created successfully
Sep 22 15:55:25 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b 1073741824
Sep 22 15:55:25 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71cabdb-a2f5-4ff9-8c45-5dd2d40046c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (89c121a4-4430-4dbd-8789-c080e4a5c17e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:25 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1fbe8009-2aff-4c35-8fd0-bc945b342b75 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created volume successfully.
Sep 22 15:55:25 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b48bcee-a44a-406d-a59e-1bf48b53db24_boud4uq9" returned: 1 in 0.453s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b48bcee-a44a-406d-a59e-1bf48b53db24_boud4uq9' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e3cad0-eb3a-4fa9-895c-589995ee72c8]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:25 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.388s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:25 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Deleted volume successfully.
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a59b8a2a-7c18-4b67-8cf0-a6a659feb64f tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-2449c526-f93c-4b28-afd7-25713ffcb2f9-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:25 devstack sudo[105147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD
Sep 22 15:55:25 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "cinder-quobyte-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8873b663-c5dc-482e-802d-a82f26638593]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:25 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:25 devstack sudo[105152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91
Sep 22 15:55:25 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:25 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b 1073741824" returned: 0 in 0.676s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:25 devstack sudo[105155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD
Sep 22 15:55:25 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:25 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b
Sep 22 15:55:25 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:25 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91" returned: 0 in 0.442s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:25 devstack sudo[105163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91
Sep 22 15:55:25 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:25 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] 1b48bcee-a44a-406d-a59e-1bf48b53db24 was raw, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:55:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:26 devstack sudo[105169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb
Sep 22 15:55:26 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:26 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b" returned: 0 in 0.306s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.554s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859249830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ead99d-da3a-4316-b630-24ab4a1ac416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:22Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Creating volume 07ead99d-da3a-4316-b630-24ab4a1ac416 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:26 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:26 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416 1073741824
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1da7f7-8063-4fe0-8af1-08cb27f02407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:26 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a468ef5-3fa1-4a0d-a182-cdb2668d2634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:26 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b (a1f47b6c-8f3c-443c-822a-1d19964e7b6b): created successfully
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a468ef5-3fa1-4a0d-a182-cdb2668d2634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (91c7f704-e81f-445a-99f6-155d766fa024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:26 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-30eb1c67-48b5-4e42-a4b5-d6d60e885300 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created volume successfully.
Sep 22 15:55:26 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91" returned: 0 in 0.348s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-quobyte-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91" released by "delete_volume" :: held 0.856s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Created reservations ['4fa20d48-7305-4a5c-8615-ebd0474dcc12', '39f09382-65be-463c-aaa6-7dcebf8e59ab', '660c89f2-e4d3-4cbd-a38b-aed16ab1346b', '96bcc51e-0167-4317-b1c9-1eefa762d31d'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:26 devstack sudo[105181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:26 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:26 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416 1073741824" returned: 0 in 0.529s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:26 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb" returned: 0 in 0.663s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b48bcee-a44a-406d-a59e-1bf48b53db24_i8uz0t3kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:55:26 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Converted 0.00 MB image at 0.00 MB/s
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:26 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416
Sep 22 15:55:26 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:26 devstack sudo[105185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb 1G
Sep 22 15:55:26 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:26 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.293s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:26 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Deleted volume successfully.
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e1930284-c245-4a7c-97bd-e73c5bc49595 tempest-CreateVolumesFromImageTest-1877646247 None] Lock "cinder-f4b2e4e7-d4d9-45f8-bf6c-c132861dff91-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:26 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416" returned: 0 in 0.293s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.878s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-11924398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7492dab5-cefd-401a-9277-999247c61ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:23Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Creating volume 7492dab5-cefd-401a-9277-999247c61ae4 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:26 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:26 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94c0fc2-f701-47ea-91db-58f6c0fc24cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ead99d-da3a-4316-b630-24ab4a1ac416', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d53464e-4dbe-4e93-bf2b-5af82e2eac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:27 devstack sudo[105193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4 1073741824
Sep 22 15:55:27 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:27 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume volume-07ead99d-da3a-4316-b630-24ab4a1ac416 (07ead99d-da3a-4316-b630-24ab4a1ac416): created successfully
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d53464e-4dbe-4e93-bf2b-5af82e2eac6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (7df27af6-59f8-4fb2-bf8c-7aa6b98806da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a8712c4d-dd72-4278-a384-754d1edb25f8 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created volume successfully.
Sep 22 15:55:27 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb 1G" returned: 0 in 0.439s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Downloaded image 1b48bcee-a44a-406d-a59e-1bf48b53db24 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b48bcee-a44a-406d-a59e-1bf48b53db24', 'metadata': {}}])) to volume 9bd4b038-af04-4d71-9a91-afb78c9a64eb successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Temporary image 1b48bcee-a44a-406d-a59e-1bf48b53db24 for user 7699c518e7874e2294b6749e2ad7ed09 is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Marking volume 9bd4b038-af04-4d71-9a91-afb78c9a64eb as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Copying metadata from image 1b48bcee-a44a-406d-a59e-1bf48b53db24 to 9bd4b038-af04-4d71-9a91-afb78c9a64eb. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Creating volume glance metadata for volume 9bd4b038-af04-4d71-9a91-afb78c9a64eb backed by image 1b48bcee-a44a-406d-a59e-1bf48b53db24 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b48bcee-a44a-406d-a59e-1bf48b53db24', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e144229a6e6105bec3b4e007bef56de0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec23377-d7a4-4b22-bf51-834cf1e9b8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb', 'volume_size': 1, 'image_id': '1b48bcee-a44a-406d-a59e-1bf48b53db24', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b48bcee-a44a-406d-a59e-1bf48b53db24', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e144229a6e6105bec3b4e007bef56de0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93d1b0bc60994373b664f1f990705815', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9419f70e4bfe3c3ac9c3f42e4fbce86a3c101cf841f4ecc7b24aeb3737d16ef6cb59344db4e840b354d3c6cf49c95c940b489b5459dab9169da61aed579bb740', 'id': '1b48bcee-a44a-406d-a59e-1bf48b53db24', 'created_at': datetime.datetime(2026, 9, 22, 13, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b48bcee-a44a-406d-a59e-1bf48b53db24/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd33778350>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481f037f-e7e8-4432-9639-9bae14ce5c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:27 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Volume volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb (9bd4b038-af04-4d71-9a91-afb78c9a64eb): created successfully
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481f037f-e7e8-4432-9639-9bae14ce5c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Flow 'volume_create_manager' (a3c2346a-889b-4d98-8e10-f9d78a6f2ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-74448d73-d231-4c91-8fc8-c79db5dc2171 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Created volume successfully.
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Acquiring lock "cinder-9bd4b038-af04-4d71-9a91-afb78c9a64eb-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:27 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4 1073741824" returned: 0 in 0.583s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "cinder-9bd4b038-af04-4d71-9a91-afb78c9a64eb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Acquiring lock "cinder-quobyte-9bd4b038-af04-4d71-9a91-afb78c9a64eb" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:27 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4
Sep 22 15:55:27 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "cinder-quobyte-9bd4b038-af04-4d71-9a91-afb78c9a64eb" acquired by "delete_volume" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f40f0-0e91-4bd8-af3a-f4bc73033644]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:27 devstack sudo[105200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb
Sep 22 15:55:27 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:27 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4" returned: 0 in 0.286s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.409s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1537350191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39dcf56-6cb0-4ebb-b531-4663303242c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5bcb059ec464683a56526927be8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:23Z,use_quota=True,user_id='d911af0225ee43d0a28e981534d4eb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Creating volume b39dcf56-6cb0-4ebb-b531-4663303242c8 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:27 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfad5166-4df7-4f36-adf6-1deef25f1f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7492dab5-cefd-401a-9277-999247c61ae4', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:27 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8 1073741824
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3729dae3-bba3-4f4f-aa72-ef3caf94e59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:27 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:27 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume volume-7492dab5-cefd-401a-9277-999247c61ae4 (7492dab5-cefd-401a-9277-999247c61ae4): created successfully
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3729dae3-bba3-4f4f-aa72-ef3caf94e59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (c959c527-8d58-4d4a-aead-5497fe71d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ec0e1cfa-41e2-4646-a0f7-4e9f841cb38b tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created volume successfully.
Sep 22 15:55:28 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb" returned: 0 in 0.437s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:28 devstack sudo[105208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb
Sep 22 15:55:28 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:28 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd4b038-af04-4d71-9a91-afb78c9a64eb" returned: 0 in 0.319s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "cinder-quobyte-9bd4b038-af04-4d71-9a91-afb78c9a64eb" released by "delete_volume" :: held 0.810s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:28 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8 1073741824" returned: 0 in 0.582s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Created reservations ['abeef09f-f5f7-4810-806f-73122c14a564', 'dcabde04-e17b-4365-a938-1bcecf785bc5', 'e780f34b-0655-40b3-8760-349e8ec98452', '0f2c0eb8-439c-444e-8f28-e34387bfc8c7'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:28 devstack sudo[105215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8
Sep 22 15:55:28 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:28 devstack sudo[105217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:28 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:28 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:28 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:28 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8" returned: 0 in 0.288s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.387s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "cinder-quobyte-a7eaed8b-ff2f-434d-8efa-969a2374c39a-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" by "_create_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d8a794-322b-425c-a83f-93361a628292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39dcf56-6cb0-4ebb-b531-4663303242c8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559d940c-e7fb-46c3-9248-bc8c6163dbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-a7eaed8b-ff2f-434d-8efa-969a2374c39a-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" acquired by "_create_volume_from_snapshot" :: waited 0.106s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Creating volume d90c94d4-a3ba-4862-a7f8-50863b4f2a60 from snapshot a7eaed8b-ff2f-434d-8efa-969a2374c39a {{(pid=85987) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "cinder-quobyte-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:28 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Volume volume-b39dcf56-6cb0-4ebb-b531-4663303242c8 (b39dcf56-6cb0-4ebb-b531-4663303242c8): created successfully
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559d940c-e7fb-46c3-9248-bc8c6163dbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Flow 'volume_create_manager' (0b142bdd-859c-47d4-8400-6e83c9dcb031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] snapshot: a7eaed8b-ff2f-434d-8efa-969a2374c39a, volume: d90c94d4-a3ba-4862-a7f8-50863b4f2a60,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:55:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-be42e855-76b5-437d-9311-634c661b0a1f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created volume successfully.
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[70af4d56-7451-4cfe-859e-c526b6d04024]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:29 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.562s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:29 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Deleted volume successfully.
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.477s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 29 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>, <Thread(Rabbit-heartbeat, started daemon 139419795786048)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a73d6481-00a0-4364-a9e5-9b34d047b2e5 tempest-VolumeAndVolumeTypeFromImageTest-297685881 None] Lock "cinder-9bd4b038-af04-4d71-9a91-afb78c9a64eb-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:29 devstack sudo[105224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a
Sep 22 15:55:29 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-b39dcf56-6cb0-4ebb-b531-4663303242c8-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-b39dcf56-6cb0-4ebb-b531-4663303242c8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-quobyte-b39dcf56-6cb0-4ebb-b531-4663303242c8" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-b39dcf56-6cb0-4ebb-b531-4663303242c8" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e17cb8-c193-4ab1-a457-c088a9d9834f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:29 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a" returned: 0 in 0.549s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[338ec988-918b-42c4-aecc-a11dae72fb3a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:29 devstack sudo[105229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8
Sep 22 15:55:29 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:29 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7
Sep 22 15:55:29 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:30 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8" returned: 0 in 0.500s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:30 devstack sudo[105240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8
Sep 22 15:55:30 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:30 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" returned: 0 in 0.515s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60 not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:30 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60
Sep 22 15:55:30 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (395e1987-1cbd-4087-bedf-3d7460c906e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b2b699-83f4-4ce2-8e98-dab61c3b2318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b2b699-83f4-4ce2-8e98-dab61c3b2318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146340055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10213d6-03ac-4d5d-9bd4-fe68a3235e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:30Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:30 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3ca7f2-de31-4f65-acd8-4f3e1e3ac15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3ca7f2-de31-4f65-acd8-4f3e1e3ac15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a4a56b-e620-465f-a9d9-9db769471275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a4a56b-e620-465f-a9d9-9db769471275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10213d6-03ac-4d5d-9bd4-fe68a3235e02', 'volume_name': 'volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe63acf-f0f6-4de9-98e3-187dc914f880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe63acf-f0f6-4de9-98e3-187dc914f880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9642fb72-458f-4398-b446-cbb05369b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:30 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume f10213d6-03ac-4d5d-9bd4-fe68a3235e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02', 'volume_size': 1}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-b39dcf56-6cb0-4ebb-b531-4663303242c8" returned: 0 in 0.399s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-b39dcf56-6cb0-4ebb-b531-4663303242c8" released by "delete_volume" :: held 0.970s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created reservations ['18cfe018-24e9-4ad2-a904-ff43154e559a', '7ed1537b-c5be-42b4-82c8-9688ede6be6e', 'dd6ac0f4-3b3b-4602-a996-72096ebee490', 'a8a6a02b-b2d4-4152-bdd5-6d5c8e5c3137'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:30 devstack sudo[105250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:30 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:31 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.494s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:31 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:31 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Deleted volume successfully.
Sep 22 15:55:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f4d753f2-fb16-41b1-b6c4-c0c2c6444b6f tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-b39dcf56-6cb0-4ebb-b531-4663303242c8-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-7492dab5-cefd-401a-9277-999247c61ae4-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-7492dab5-cefd-401a-9277-999247c61ae4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-quobyte-7492dab5-cefd-401a-9277-999247c61ae4" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-7492dab5-cefd-401a-9277-999247c61ae4" acquired by "delete_volume" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:32 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc3d252-461d-460d-bdef-11815f9890b1]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:32 devstack sudo[105260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4
Sep 22 15:55:32 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:32 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4" returned: 0 in 0.792s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:33 devstack sudo[105266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4
Sep 22 15:55:33 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:33 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-7492dab5-cefd-401a-9277-999247c61ae4" returned: 0 in 0.488s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:33 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-7492dab5-cefd-401a-9277-999247c61ae4" released by "delete_volume" :: held 1.400s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:33 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created reservations ['59608e1f-271a-41f7-8c8a-4a2256d77f1c', '21823280-5880-4afa-8b8a-80a946a442d2', 'a05a1759-3937-47c7-87d5-99e3ed2cbd01', '58a77142-74df-4a64-9f8f-6a1899d2e11e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:33 devstack sudo[105269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:33 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:34 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.490s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:34 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:34 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Deleted volume successfully.
Sep 22 15:55:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-edbd1f97-d9ee-47d4-8923-09279a435632 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-7492dab5-cefd-401a-9277-999247c61ae4-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-07ead99d-da3a-4316-b630-24ab4a1ac416-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-07ead99d-da3a-4316-b630-24ab4a1ac416-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-quobyte-07ead99d-da3a-4316-b630-24ab4a1ac416" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-07ead99d-da3a-4316-b630-24ab4a1ac416" acquired by "delete_volume" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:34 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7122c0-d4d7-42f6-91b8-fa408228005e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:34 devstack sudo[105272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416
Sep 22 15:55:34 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:35 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416" returned: 0 in 0.717s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:35 devstack sudo[105278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416
Sep 22 15:55:35 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:35 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-07ead99d-da3a-4316-b630-24ab4a1ac416" returned: 0 in 0.467s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-07ead99d-da3a-4316-b630-24ab4a1ac416" released by "delete_volume" :: held 1.285s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:35 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created reservations ['341ca11b-19dc-4104-9522-e2998cea6b5c', '97ed151c-c549-4755-8889-0500cf568a87', '642f3ca1-b05e-48fc-92cf-b5ed84f13b2e', '1103bef7-4196-435f-ac6f-e8ce53f4e702'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:36 devstack sudo[105281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:36 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:36 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.485s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Deleted volume successfully.
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9f138257-1f07-44d9-b8c7-8faffe2ac4a3 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-07ead99d-da3a-4316-b630-24ab4a1ac416-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-a1f47b6c-8f3c-443c-822a-1d19964e7b6b-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-a1f47b6c-8f3c-443c-822a-1d19964e7b6b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-quobyte-a1f47b6c-8f3c-443c-822a-1d19964e7b6b" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-a1f47b6c-8f3c-443c-822a-1d19964e7b6b" acquired by "delete_volume" :: waited 0.039s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:37 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ba67f8-b4f4-49f6-87c7-3d0c13824b63]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:37 devstack sudo[105284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b
Sep 22 15:55:37 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:37 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b" returned: 0 in 0.565s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:37 devstack sudo[105291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b
Sep 22 15:55:37 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:38 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a1f47b6c-8f3c-443c-822a-1d19964e7b6b" returned: 0 in 0.678s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-a1f47b6c-8f3c-443c-822a-1d19964e7b6b" released by "delete_volume" :: held 1.362s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created reservations ['84824550-4075-4422-bb57-386f5bf04c3c', 'bc574699-11c6-42d3-858b-d7d1b290c516', '07f9dbe8-f542-45b0-8d49-cbafb8cfc237', '11728427-6732-4f86-b766-47373c5c8626'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:38 devstack sudo[105294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:38 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:38 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" returned: 0 in 8.460s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7, size 1024.00 MB, duration 8.46 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:55:38 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Converted 1024.00 MB image at 121.02 MB/s
Sep 22 15:55:38 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60 is being set with open permissions: ugo+rw
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:38 devstack sudo[105296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60
Sep 22 15:55:38 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:38 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.294s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Deleted volume successfully.
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-6404a53f-41ab-492c-8dd1-6d0650762c15 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-a1f47b6c-8f3c-443c-822a-1d19964e7b6b-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:38 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" returned: 0 in 0.288s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" released by "_copy_volume_from_snapshot" :: held 9.975s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-a7eaed8b-ff2f-434d-8efa-969a2374c39a-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" released by "_create_volume_from_snapshot" :: held 10.083s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.192s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.482s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146340055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10213d6-03ac-4d5d-9bd4-fe68a3235e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:30Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Creating volume f10213d6-03ac-4d5d-9bd4-fe68a3235e02 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:39 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:39 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02 1073741824
Sep 22 15:55:39 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c34460-c8f6-42de-a41f-52516b950091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60', 'volume_size': 1, 'snapshot_id': 'a7eaed8b-ff2f-434d-8efa-969a2374c39a'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1459df1-ff41-42cc-8d5a-dfb144c17c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:39 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Volume volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60 (d90c94d4-a3ba-4862-a7f8-50863b4f2a60): created successfully
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1459df1-ff41-42cc-8d5a-dfb144c17c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Flow 'volume_create_manager' (11f9105e-2c54-4468-b2bd-0637b4984f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-874d6d56-8b03-42a9-ab67-4862603c5adf tempest-VolumeDependencyTests-1473029914 None] Created volume successfully.
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-14c3c032-b98c-4530-acf8-c119fda7ae65-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-14c3c032-b98c-4530-acf8-c119fda7ae65-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-quobyte-14c3c032-b98c-4530-acf8-c119fda7ae65" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-14c3c032-b98c-4530-acf8-c119fda7ae65" acquired by "delete_volume" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5b8e6a-b919-4bf5-a466-f27bf4f2abcc]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:39 devstack sudo[105305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65
Sep 22 15:55:39 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:39 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02 1073741824" returned: 0 in 0.578s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "cinder-a7eaed8b-ff2f-434d-8efa-969a2374c39a-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:39 devstack sudo[105308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02
Sep 22 15:55:39 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-a7eaed8b-ff2f-434d-8efa-969a2374c39a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "cinder-quobyte-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "cinder-quobyte-a7eaed8b-ff2f-434d-8efa-969a2374c39a" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-a7eaed8b-ff2f-434d-8efa-969a2374c39a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Deleting offline snapshot a7eaed8b-ff2f-434d-8efa-969a2374c39a of volume ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] snapshot_file for this snap is: volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3ffdc5-fac9-4498-a395-e6d702799969]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:39 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65" returned: 0 in 0.516s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:39 devstack sudo[105314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65
Sep 22 15:55:39 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:39 devstack sudo[105312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a
Sep 22 15:55:39 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:39 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02" returned: 0 in 0.342s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9642fb72-458f-4398-b446-cbb05369b473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c71537-c2d0-490c-adf1-c8b3a1ea769b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:40 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02 (f10213d6-03ac-4d5d-9bd4-fe68a3235e02): created successfully
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c71537-c2d0-490c-adf1-c8b3a1ea769b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (395e1987-1cbd-4087-bedf-3d7460c906e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b4f6875d-264a-447e-8353-d9eccfec38c4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created volume successfully.
Sep 22 15:55:40 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-14c3c032-b98c-4530-acf8-c119fda7ae65" returned: 0 in 0.333s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-14c3c032-b98c-4530-acf8-c119fda7ae65" released by "delete_volume" :: held 0.896s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:40 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a" returned: 0 in 0.498s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[67565775-ffcf-42c4-9e96-5ff50f4cfd45]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created reservations ['4c51c441-a3b2-4f1f-85d0-c1c48792957b', 'b07fc9e3-d05f-4596-b71a-6b366d457c22', 'a66b7d4f-7ffd-49ba-99e8-50cf3e2aa6e4', '6640194b-c955-4ae4-8a08-ab58572a68d1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:40 devstack sudo[105323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:40 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-3a3574af-1f0e-4591-8911-05626a52a0aa-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-3a3574af-1f0e-4591-8911-05626a52a0aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-quobyte-40a0f2e0-6185-433b-839b-fd726a23d7a7" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-40a0f2e0-6185-433b-839b-fd726a23d7a7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-quobyte-3a3574af-1f0e-4591-8911-05626a52a0aa" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:40 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7
Sep 22 15:55:40 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-3a3574af-1f0e-4591-8911-05626a52a0aa" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Deleting offline snapshot 3a3574af-1f0e-4591-8911-05626a52a0aa of volume 40a0f2e0-6185-433b-839b-fd726a23d7a7 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] snapshot_file for this snap is: volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6016bde-1e18-4bf3-bed0-d7db622576a6]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:40 devstack sudo[105327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa
Sep 22 15:55:40 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:40 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.427s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Deleted volume successfully.
Sep 22 15:55:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-79b79e49-27b2-41e9-99f2-98b2ac43ceeb tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-14c3c032-b98c-4530-acf8-c119fda7ae65-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:41 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" returned: 0 in 0.837s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:41 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a
Sep 22 15:55:41 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (08625e47-3202-4556-a8e9-4213540b0dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c444bc-2c51-45dd-8447-3dd0360dc6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa" returned: 0 in 0.659s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40a0f2e0-6185-433b-839b-fd726a23d7a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c444bc-2c51-45dd-8447-3dd0360dc6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-3014521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:41Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603bd97c-e057-49b9-a2b7-b87df3b00eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603bd97c-e057-49b9-a2b7-b87df3b00eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52debd3-0a4d-4fe0-9569-6f4d3754e1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52debd3-0a4d-4fe0-9569-6f4d3754e1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6', 'volume_name': 'volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d875ec4a-4b2e-4bb7-850f-efa68bee6678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d875ec4a-4b2e-4bb7-850f-efa68bee6678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6262b073-75d4-45f4-950e-a7ca7bc733ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6', 'volume_size': 1}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-3014521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:41Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Creating volume cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:41 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[88925cb1-1ebe-4db5-99b9-4f410944b43c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:41 devstack sudo[105338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6 1073741824
Sep 22 15:55:41 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:41 devstack sudo[105339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7
Sep 22 15:55:41 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:41 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a" returned: 0 in 0.566s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:41 devstack sudo[105348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a
Sep 22 15:55:41 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (f1f02b86-232b-4bfd-a970-59ab319fce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4024771c-87ad-4a67-b9d8-de0cb5b3df5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4024771c-87ad-4a67-b9d8-de0cb5b3df5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1330325758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293f5d7d-3ba3-4918-a89c-fbe6ce012cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:42Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8db881c-b3a6-460d-9edd-4266ab7e34ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8db881c-b3a6-460d-9edd-4266ab7e34ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41197341-dc50-4f83-8d28-62aa02f0b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41197341-dc50-4f83-8d28-62aa02f0b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '293f5d7d-3ba3-4918-a89c-fbe6ce012cf0', 'volume_name': 'volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368bf575-e644-4f74-bf16-8e3b9e232c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368bf575-e644-4f74-bf16-8e3b9e232c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75768eec-fceb-4860-b75b-abaf8ac9a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:41 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume 293f5d7d-3ba3-4918-a89c-fbe6ce012cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0', 'volume_size': 1}
Sep 22 15:55:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:42 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:42 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6 1073741824" returned: 0 in 0.775s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7" returned: 0 in 0.765s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:42 devstack sudo[105354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa
Sep 22 15:55:42 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:42 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7.a7eaed8b-ff2f-434d-8efa-969a2374c39a" returned: 0 in 0.559s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:42 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6
Sep 22 15:55:42 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (97eb1249-27ed-4f44-91c8-b2a0c6442c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68eca4c-5f4e-4411-acfb-4df97329ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-a7eaed8b-ff2f-434d-8efa-969a2374c39a" released by "_delete_snapshot" :: held 2.702s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" released by "delete_snapshot" :: held 2.739s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68eca4c-5f4e-4411-acfb-4df97329ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-83567645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc15dc33-3b94-4ed4-908b-ce0ff3f695fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:42Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856d48b6-0d93-4bd9-91fa-355886c03ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856d48b6-0d93-4bd9-91fa-355886c03ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935056dc-6ee8-460a-b08e-bcb332c72c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935056dc-6ee8-460a-b08e-bcb332c72c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc15dc33-3b94-4ed4-908b-ce0ff3f695fe', 'volume_name': 'volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5e9133-db84-4766-ba90-8909b9719fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5e9133-db84-4766-ba90-8909b9719fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc84c2e-b76a-4461-9db1-134a55d53029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:42 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume dc15dc33-3b94-4ed4-908b-ce0ff3f695fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe', 'volume_size': 1}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Created reservations ['d44e7d33-30f0-40b8-a703-c9d36321c68a', '4f5c3f7a-23bc-4bd3-9938-87e0fffa78e2', 'cecab928-0262-47ca-94a5-8f7281fbdcfa', 'e935b2a9-6bda-4db4-8686-a0c6917e700b'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:42 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa" returned: 0 in 0.521s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:42 devstack sudo[105363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa
Sep 22 15:55:42 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:42 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6" returned: 0 in 0.484s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1330325758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293f5d7d-3ba3-4918-a89c-fbe6ce012cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:42Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Creating volume 293f5d7d-3ba3-4918-a89c-fbe6ce012cf0 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:42 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:42 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0 1073741824
Sep 22 15:55:42 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6262b073-75d4-45f4-950e-a7ca7bc733ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fdf61c-0f54-492e-916d-bc31d5a48f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Delete snapshot completed successfully.
Sep 22 15:55:42 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6 (cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6): created successfully
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fdf61c-0f54-492e-916d-bc31d5a48f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (08625e47-3202-4556-a8e9-4213540b0dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (05207ae8-b29b-4fd5-9539-ffb7f48930fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5d5b21-9d31-4f53-aa30-21be0a08496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-b0b67a1e-9d73-463e-bcc6-de0a17ec5117 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-a7eaed8b-ff2f-434d-8efa-969a2374c39a-delete_snapshot" released by "delete_snapshot" :: held 3.396s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-fa724bec-96a5-44ae-9e4c-0138a30c246f tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created volume successfully.
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5d5b21-9d31-4f53-aa30-21be0a08496d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315696221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb0e159-9e0a-431e-b7ad-96dafd980fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:43Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4762bc-cfce-43fd-b13a-2b5930bd3c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4762bc-cfce-43fd-b13a-2b5930bd3c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:43 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e7683d-a523-4609-8858-0df7cfe9b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e7683d-a523-4609-8858-0df7cfe9b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb0e159-9e0a-431e-b7ad-96dafd980fe2', 'volume_name': 'volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8136d8f-847c-4db5-ad35-6a174e4c2911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8136d8f-847c-4db5-ad35-6a174e4c2911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e60e30c-0b72-44a4-b80e-5ff2459b71ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume adb0e159-9e0a-431e-b7ad-96dafd980fe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2', 'volume_size': 1}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "cinder-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7.3a3574af-1f0e-4591-8911-05626a52a0aa" returned: 0 in 0.455s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-3a3574af-1f0e-4591-8911-05626a52a0aa" released by "_delete_snapshot" :: held 2.674s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-40a0f2e0-6185-433b-839b-fd726a23d7a7" released by "delete_snapshot" :: held 2.724s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "cinder-quobyte-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" acquired by "delete_volume" :: waited 0.038s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0550663c-c993-4dc7-8630-898120dc4b27]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created reservations ['667e21b3-31b1-4f84-bc20-d0ebcaadc84f', '4258819f-6032-42d5-b884-7cb69e17557d', 'f85ab6fa-e409-403c-8f04-f728d924d64b', '1304a116-ca09-48e5-8faf-b5689b15b963'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:43 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7
Sep 22 15:55:43 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:43 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Delete snapshot completed successfully.
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0 1073741824" returned: 0 in 0.797s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-32ad666e-530d-4cdd-9b30-8c6fd7716f82 tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-3a3574af-1f0e-4591-8911-05626a52a0aa-delete_snapshot" released by "delete_snapshot" :: held 3.096s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (8e7d355f-c5ed-44a9-a1a8-9aa8aa2c0f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dac08ae-6ada-430f-bcc5-e7c39d92c595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dac08ae-6ada-430f-bcc5-e7c39d92c595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105289231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823948f9-3911-47ec-a03e-5da4d197815a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:44Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922c8050-9341-407a-82ba-bd551fd46728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922c8050-9341-407a-82ba-bd551fd46728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939774b6-1e9c-413d-be0a-bb20ff6ec778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939774b6-1e9c-413d-be0a-bb20ff6ec778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823948f9-3911-47ec-a03e-5da4d197815a', 'volume_name': 'volume-823948f9-3911-47ec-a03e-5da4d197815a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920e71e8-62d5-43c8-a033-602c817e3cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920e71e8-62d5-43c8-a033-602c817e3cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd41a61-93c4-4cab-9366-e2ad7b963d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:43 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume 823948f9-3911-47ec-a03e-5da4d197815a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823948f9-3911-47ec-a03e-5da4d197815a', 'volume_size': 1}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:43 devstack sudo[105374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0
Sep 22 15:55:43 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-40a0f2e0-6185-433b-839b-fd726a23d7a7-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-40a0f2e0-6185-433b-839b-fd726a23d7a7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "cinder-quobyte-40a0f2e0-6185-433b-839b-fd726a23d7a7" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-40a0f2e0-6185-433b-839b-fd726a23d7a7" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:43 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" returned: 0 in 0.532s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f46545-2ca2-441a-80de-5f1c98ed3e29]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:44 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7
Sep 22 15:55:44 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:44 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0" returned: 0 in 0.361s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-83567645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc15dc33-3b94-4ed4-908b-ce0ff3f695fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:42Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Creating volume dc15dc33-3b94-4ed4-908b-ce0ff3f695fe {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:44 devstack sudo[105381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7
Sep 22 15:55:44 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:44 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75768eec-fceb-4860-b75b-abaf8ac9a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04b9d16-9302-483b-957e-07ef60c05703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:44 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe 1073741824
Sep 22 15:55:44 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0 (293f5d7d-3ba3-4918-a89c-fbe6ce012cf0): created successfully
Sep 22 15:55:44 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04b9d16-9302-483b-957e-07ef60c05703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (f1f02b86-232b-4bfd-a970-59ab319fce1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:44 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8de9ec2c-ba0e-4094-be38-55b46d91e436 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created volume successfully.
Sep 22 15:55:44 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" returned: 0 in 0.370s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7" released by "delete_volume" :: held 1.013s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Created reservations ['b651e8ca-b74c-43e8-a577-8cad6f4e3e37', 'ff850756-adde-4aee-b9e4-83998491f65e', '41b1d5e2-966f-4519-99b7-328858f4ebf6', '1b8e183a-6986-46d3-be2b-349a59f1acc3'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:44 devstack sudo[105393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:44 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:44 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7" returned: 0 in 0.622s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:44 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7
Sep 22 15:55:44 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:44 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe 1073741824" returned: 0 in 0.722s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:44 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.351s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:44 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Deleted volume successfully.
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8d6392ed-4780-4690-bf60-1e9c868a0311 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-ab1c8e57-a0e5-47c9-8d3e-a387cef464b7-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:44 devstack sudo[105399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe
Sep 22 15:55:44 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:44 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:44 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (64fa0d25-6939-49e7-804c-166f169d6cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a9aea5-1476-42c7-b300-bf8428c2f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40a0f2e0-6185-433b-839b-fd726a23d7a7" returned: 0 in 0.392s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a9aea5-1476-42c7-b300-bf8428c2f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1854039110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a981cf4b-51c9-44b9-93a2-69ab192de126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:45Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac31551-00bc-457d-927c-d6d642740fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac31551-00bc-457d-927c-d6d642740fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a87f240-d1f6-4814-bc4e-247d39490f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a87f240-d1f6-4814-bc4e-247d39490f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a981cf4b-51c9-44b9-93a2-69ab192de126', 'volume_name': 'volume-a981cf4b-51c9-44b9-93a2-69ab192de126', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68428e2d-47f2-4b1d-bf0c-3fcc89484864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68428e2d-47f2-4b1d-bf0c-3fcc89484864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaff025-6bc7-4125-810e-2a82db73a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:45 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Volume a981cf4b-51c9-44b9-93a2-69ab192de126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a981cf4b-51c9-44b9-93a2-69ab192de126', 'volume_size': 1}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-quobyte-40a0f2e0-6185-433b-839b-fd726a23d7a7" released by "delete_volume" :: held 1.142s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Created reservations ['25ec8f8c-90b3-4df2-86aa-a8e8017e7b9a', 'c7167784-c8d0-4d13-b505-828a83a8e4dd', '55bfbc36-1af9-4e38-9768-7e0bc95e894e', '5501834a-9709-4d42-a1e6-a9a3f9bfcf5d'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:45 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe" returned: 0 in 0.299s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.047s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315696221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb0e159-9e0a-431e-b7ad-96dafd980fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:43Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Creating volume adb0e159-9e0a-431e-b7ad-96dafd980fe2 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:45 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:45 devstack sudo[105403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:45 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc84c2e-b76a-4461-9db1-134a55d53029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:45 devstack sudo[105405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2 1073741824
Sep 22 15:55:45 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d5af17-dc55-48b4-8814-1a9518d7a2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:45 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe (dc15dc33-3b94-4ed4-908b-ce0ff3f695fe): created successfully
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d5af17-dc55-48b4-8814-1a9518d7a2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (97eb1249-27ed-4f44-91c8-b2a0c6442c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-79e062b3-28c0-4f6b-9d2b-95b1e68e9c95 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created volume successfully.
Sep 22 15:55:45 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.273s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Deleted volume successfully.
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "cinder-d90c94d4-a3ba-4862-a7f8-50863b4f2a60-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-09d82d83-fe2b-4904-acd7-9a2685dc928c tempest-CreateVolumesFromSnapshotTest-1246752176 None] Lock "cinder-40a0f2e0-6185-433b-839b-fd726a23d7a7-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-d90c94d4-a3ba-4862-a7f8-50863b4f2a60-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "cinder-quobyte-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0579300-e84f-4a4e-adf3-6a18a8411f90]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:45 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60
Sep 22 15:55:45 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:45 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2 1073741824" returned: 0 in 0.554s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:45 devstack sudo[105415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2
Sep 22 15:55:45 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:46 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" returned: 0 in 0.473s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:46 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2" returned: 0 in 0.297s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:46 devstack sudo[105422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60
Sep 22 15:55:46 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.389s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105289231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823948f9-3911-47ec-a03e-5da4d197815a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd84b5dd5d6242cda1e35478df388275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:44Z,use_quota=True,user_id='5778209faef340b19a67852f0380cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Creating volume 823948f9-3911-47ec-a03e-5da4d197815a {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:46 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e60e30c-0b72-44a4-b80e-5ff2459b71ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715cee44-5abe-4f02-aad1-beb0e18a2719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:46 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a 1073741824
Sep 22 15:55:46 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:46 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2 (adb0e159-9e0a-431e-b7ad-96dafd980fe2): created successfully
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715cee44-5abe-4f02-aad1-beb0e18a2719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (05207ae8-b29b-4fd5-9539-ffb7f48930fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-19e0bb0f-2755-4d71-bd1f-6413ed78a7ba tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created volume successfully.
Sep 22 15:55:46 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" returned: 0 in 0.269s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-quobyte-d90c94d4-a3ba-4862-a7f8-50863b4f2a60" released by "delete_volume" :: held 0.804s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Created reservations ['a374c7a1-73fa-4c7a-9aa5-c5beaf4ab6df', 'b4e65a9d-11d1-4de6-96ed-68cecf78532a', 'ec394733-8d92-4bb2-82bb-67602a5479ea', 'b6a9c7ad-83f7-4f3d-8c4d-f87c560d4f17'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:46 devstack sudo[105430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:46 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:46 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a 1073741824" returned: 0 in 0.594s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:46 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a
Sep 22 15:55:46 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:46 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.345s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Deleted volume successfully.
Sep 22 15:55:46 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4c48eaef-0717-4e2c-85be-c05988f61039 tempest-VolumeDependencyTests-1473029914 None] Lock "cinder-d90c94d4-a3ba-4862-a7f8-50863b4f2a60-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:47 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a" returned: 0 in 0.347s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.075s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1854039110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a981cf4b-51c9-44b9-93a2-69ab192de126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:45Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Creating volume a981cf4b-51c9-44b9-93a2-69ab192de126 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:47 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd41a61-93c4-4cab-9366-e2ad7b963d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823948f9-3911-47ec-a03e-5da4d197815a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:47 devstack sudo[105437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126 1073741824
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b18e17-23da-4cea-9849-91042055006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:47 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:47 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Volume volume-823948f9-3911-47ec-a03e-5da4d197815a (823948f9-3911-47ec-a03e-5da4d197815a): created successfully
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b18e17-23da-4cea-9849-91042055006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Flow 'volume_create_manager' (8e7d355f-c5ed-44a9-a1a8-9aa8aa2c0f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:47 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e82b9ffd-745c-4c37-ac2d-cce9b1a84ea8 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created volume successfully.
Sep 22 15:55:47 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126 1073741824" returned: 0 in 0.501s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:47 devstack sudo[105442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126
Sep 22 15:55:47 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:48 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126" returned: 0 in 0.334s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaff025-6bc7-4125-810e-2a82db73a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a981cf4b-51c9-44b9-93a2-69ab192de126', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125a3cf1-0990-4b22-abc9-b1bcbcf69d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:48 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Volume volume-a981cf4b-51c9-44b9-93a2-69ab192de126 (a981cf4b-51c9-44b9-93a2-69ab192de126): created successfully
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125a3cf1-0990-4b22-abc9-b1bcbcf69d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (64fa0d25-6939-49e7-804c-166f169d6cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f770ff44-af11-45a9-bbf2-5c99844f6149 tempest-ProjectMemberTests-1212956627 None] Created volume successfully.
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-823948f9-3911-47ec-a03e-5da4d197815a-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-823948f9-3911-47ec-a03e-5da4d197815a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-quobyte-823948f9-3911-47ec-a03e-5da4d197815a" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-823948f9-3911-47ec-a03e-5da4d197815a" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5106e098-29f3-4ae6-9ddb-8db620aad055]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:48 devstack sudo[105446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a
Sep 22 15:55:48 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:48 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a" returned: 0 in 0.446s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:48 devstack sudo[105451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a
Sep 22 15:55:48 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:49 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-823948f9-3911-47ec-a03e-5da4d197815a" returned: 0 in 0.324s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-823948f9-3911-47ec-a03e-5da4d197815a" released by "delete_volume" :: held 0.839s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created reservations ['ea05d885-0d1f-49ce-bd9f-c938584ab47b', '8f4b12db-cb78-415f-a8ad-675261ee93fd', '1724b746-4d63-40c2-9479-a159d6460637', 'f5d45adc-bf33-48ef-8ed7-a7003202d78f'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:49 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:49 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-adb0e159-9e0a-431e-b7ad-96dafd980fe2-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-adb0e159-9e0a-431e-b7ad-96dafd980fe2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-quobyte-adb0e159-9e0a-431e-b7ad-96dafd980fe2" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-adb0e159-9e0a-431e-b7ad-96dafd980fe2" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dab13b0-7b8d-4c69-a2d6-dc530b6e1c15]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:49 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2
Sep 22 15:55:49 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:49 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.497s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Deleted volume successfully.
Sep 22 15:55:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e81a5ce0-b076-4754-a9ca-2142b4783c2a tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-823948f9-3911-47ec-a03e-5da4d197815a-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Creating offline snapshot 6c40d46e-7d9e-40c7-8d28-78f448e5de4d of volume a981cf4b-51c9-44b9-93a2-69ab192de126 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0cc7a5-7d14-40ea-ab6b-cc51095b9e0e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:50 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2" returned: 0 in 0.578s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:50 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126
Sep 22 15:55:50 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:50 devstack sudo[105464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2
Sep 22 15:55:50 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:50 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126" returned: 0 in 0.484s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:50 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-adb0e159-9e0a-431e-b7ad-96dafd980fe2" returned: 0 in 0.382s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:50 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d 1G
Sep 22 15:55:50 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-adb0e159-9e0a-431e-b7ad-96dafd980fe2" released by "delete_volume" :: held 1.054s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created reservations ['a7ef73c2-581d-4ee2-8291-81bebe754580', '0bd092a7-bacd-4f93-a9d7-6c1bc0fc2ac7', 'fb3ee5d6-b93e-4221-b7b9-60f27da98f3e', 'ee12442d-712c-483b-9dc8-f215b67f06a1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:50 devstack sudo[105475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:50 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:51 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:51 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.355s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d 1G" returned: 0 in 0.587s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a981cf4b-51c9-44b9-93a2-69ab192de126 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:51 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Deleted volume successfully.
Sep 22 15:55:51 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a981cf4b-51c9-44b9-93a2-69ab192de126 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d
Sep 22 15:55:51 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a383463c-f344-4c99-a848-a3255cc06de4 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-adb0e159-9e0a-431e-b7ad-96dafd980fe2-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:51 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a981cf4b-51c9-44b9-93a2-69ab192de126 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d" returned: 0 in 0.371s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:51 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d is being set with open permissions: ugo+rw
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:51 devstack sudo[105487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d
Sep 22 15:55:51 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-14874fba-d1ca-447d-9b1d-73cbdf9d2cd8 tempest-ProjectAdminTests-1059522839 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5676803588867, 'free_capacity_gb': 1775.5676803588867, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85987) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:51 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d" returned: 0 in 0.302s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:51 devstack sudo[105490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.info
Sep 22 15:55:51 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-quobyte-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e9d38c-fa00-4ab1-adff-58edc43b5c44]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:52 devstack sudo[105492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe
Sep 22 15:55:52 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:52 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.info" returned: 0 in 0.306s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:52 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.info is being set with open permissions: ugo+rw
Sep 22 15:55:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:52 devstack sudo[105495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.info
Sep 22 15:55:52 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:52 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.info" returned: 0 in 0.299s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:52 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe" returned: 0 in 0.537s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:52 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a388f130-5373-4755-8789-0879d4ed6a1b tempest-ProjectMemberTests-1212956627 None] Create snapshot completed successfully
Sep 22 15:55:52 devstack sudo[105501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe
Sep 22 15:55:52 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:52 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe" returned: 0 in 0.297s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe" released by "delete_volume" :: held 0.902s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:52 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created reservations ['cac6d3df-2c5f-45d0-ab4f-65dba0f58cd9', '6b45c553-4778-4a3f-a642-9cdb74b3db25', 'fd8912d3-948d-4f84-9286-9d862f257265', 'd6207bab-3557-4b5e-adce-556b40c4eacb'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:53 devstack sudo[105504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:53 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-quobyte-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-6c40d46e-7d9e-40c7-8d28-78f448e5de4d-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3649cba-e138-4631-a074-b43bc1faf2ce]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-6c40d46e-7d9e-40c7-8d28-78f448e5de4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-a981cf4b-51c9-44b9-93a2-69ab192de126" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-a981cf4b-51c9-44b9-93a2-69ab192de126" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-6c40d46e-7d9e-40c7-8d28-78f448e5de4d" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-6c40d46e-7d9e-40c7-8d28-78f448e5de4d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Deleting offline snapshot 6c40d46e-7d9e-40c7-8d28-78f448e5de4d of volume a981cf4b-51c9-44b9-93a2-69ab192de126 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:55:53 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] snapshot_file for this snap is: volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.432s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Deleted volume successfully.
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdc0b21-1cae-40e4-9301-7f54e8d051b2]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-333ebd52-2953-4569-bd44-23077bf46e44 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-dc15dc33-3b94-4ed4-908b-ce0ff3f695fe-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:53 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0
Sep 22 15:55:53 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:53 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d
Sep 22 15:55:53 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:53 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0" returned: 0 in 0.605s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:53 devstack sudo[105517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0
Sep 22 15:55:53 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:54 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d" returned: 0 in 0.547s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a981cf4b-51c9-44b9-93a2-69ab192de126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a261b496-0f51-4f56-b64f-30584777732e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:54 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126
Sep 22 15:55:54 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:54 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0" released by "delete_volume" :: held 1.002s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created reservations ['08a451f9-3339-4942-aa6d-4b62c36c029d', 'd9785828-ae0f-4941-a61c-a502617f6fc3', '4250beba-4cb2-4479-8f08-8f1a019ce48e', '23c97b49-7142-4064-b0c3-7814b76cf414'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:54 devstack sudo[105522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:54 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:54 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126" returned: 0 in 0.551s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:54 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d
Sep 22 15:55:54 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:54 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.389s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:54 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Deleted volume successfully.
Sep 22 15:55:54 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4e2b15ef-9df2-4c6b-b259-57d87e0b7e77 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-293f5d7d-3ba3-4918-a89c-fbe6ce012cf0-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:55 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Flow 'volume_create_manager' (a14f8dcc-257d-4d87-96cc-3b44ae56070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d6bb5c-8b0e-472e-918a-7a95cc962201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d" returned: 0 in 0.570s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d6bb5c-8b0e-472e-918a-7a95cc962201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f84371-a9f9-49de-8e67-e80ce88db78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b396a7bf9ab450486b28b1312e391c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:55Z,use_quota=True,user_id='0f293d9722da46d7be561653cdb295bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:55 devstack sudo[105533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d
Sep 22 15:55:55 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9e1649-6315-4282-a668-dab43f026d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9e1649-6315-4282-a668-dab43f026d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f62523-1aab-4c0b-9c9c-17ca725bfb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.image.glance [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Creating Keystone auth plugin from conf {{(pid=85987) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:55 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126.6c40d46e-7d9e-40c7-8d28-78f448e5de4d" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-quobyte-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-6c40d46e-7d9e-40c7-8d28-78f448e5de4d" released by "_delete_snapshot" :: held 2.171s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-a981cf4b-51c9-44b9-93a2-69ab192de126" released by "delete_snapshot" :: held 2.204s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d755235-3844-4565-8be0-344e50084c46]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f62523-1aab-4c0b-9c9c-17ca725bfb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53f84371-a9f9-49de-8e67-e80ce88db78b', 'volume_name': 'volume-53f84371-a9f9-49de-8e67-e80ce88db78b', 'volume_size': 1, 'image_id': '7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19244f7c478da9fd4a2b16858f192bad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b396a7bf9ab450486b28b1312e391c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5505630c6d1d15e713885918ab365b7e5f8009e17f33b4ccdbc7967e4f09d19a27f65da3985d97f565c6d674f9437e00f11a9692244dd57b47cddf9569370125', 'id': '7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'created_at': datetime.datetime(2026, 9, 22, 13, 55, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 55, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7603674b-8f5d-4cc4-9bae-b2be83cbfe21/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd33696c00>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a8254c-9d46-47df-8ce9-7e6a6ad17f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a8254c-9d46-47df-8ce9-7e6a6ad17f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b9f5ca-7441-4992-87e0-01697726f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:55 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Volume 53f84371-a9f9-49de-8e67-e80ce88db78b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53f84371-a9f9-49de-8e67-e80ce88db78b', 'volume_size': 1, 'image_id': '7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19244f7c478da9fd4a2b16858f192bad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b396a7bf9ab450486b28b1312e391c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5505630c6d1d15e713885918ab365b7e5f8009e17f33b4ccdbc7967e4f09d19a27f65da3985d97f565c6d674f9437e00f11a9692244dd57b47cddf9569370125', 'id': '7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'created_at': datetime.datetime(2026, 9, 22, 13, 55, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 55, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7603674b-8f5d-4cc4-9bae-b2be83cbfe21/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd33696c00>}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Trying to clone 53f84371-a9f9-49de-8e67-e80ce88db78b from image 7603674b-8f5d-4cc4-9bae-b2be83cbfe21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'metadata': {}}]). {{(pid=85987) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Created reservations ['9d7e4981-52db-4468-9787-bea6f6a1db74', 'b77aa448-b733-42ec-8c67-d0d055c144be', '3fb4dedd-8e93-45ff-b9cd-9f1d8d043610', 'e464a412-3850-4b14-a79b-3d90489ccec7'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:55 devstack sudo[105536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6
Sep 22 15:55:55 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:55 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Delete snapshot completed successfully.
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-423cf2b2-53cd-4a23-9888-f7aa19cd2fc4 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-6c40d46e-7d9e-40c7-8d28-78f448e5de4d-delete_snapshot" released by "delete_snapshot" :: held 2.489s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 22 15:55:55 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Image download 0.00 MB at 0.00 MB/s
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[016ec8a7-c854-4e2a-860e-7af8c13f0000]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:56 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6" returned: 0 in 0.451s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:56 devstack sudo[105538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD
Sep 22 15:55:56 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:56 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6
Sep 22 15:55:56 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:56 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:56 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6" returned: 0 in 0.264s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6" released by "delete_volume" :: held 0.776s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created reservations ['4ae2c3f9-fc9e-4294-bccd-b79b1d6be136', 'e825b238-98e1-4c51-b2d8-3e53fb15721d', '553ce02e-0e6e-4cd7-8ca4-ae0e2bff4db1', '81c2c791-4276-46c6-95f3-7b0d82bdf9fc'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:56 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD
Sep 22 15:55:56 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:56 devstack sudo[105550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:56 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-a981cf4b-51c9-44b9-93a2-69ab192de126-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-a981cf4b-51c9-44b9-93a2-69ab192de126-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:56 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Temporary image 7603674b-8f5d-4cc4-9bae-b2be83cbfe21 is fetched for user 0f293d9722da46d7be561653cdb295bb. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-f10213d6-03ac-4d5d-9bd4-fe68a3235e02-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-a981cf4b-51c9-44b9-93a2-69ab192de126" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-f10213d6-03ac-4d5d-9bd4-fe68a3235e02-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-a981cf4b-51c9-44b9-93a2-69ab192de126" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:56 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a6e03f-5dfb-40bc-9dd4-dc9f12e446bf]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.341s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:56 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Deleted volume successfully.
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d4d138-38eb-43c5-aeaf-c31ff1842419]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "cinder-quobyte-f10213d6-03ac-4d5d-9bd4-fe68a3235e02" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c5e6d810-a8e1-424d-af4e-af81745eb82d tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-cd547e6c-b5d6-4c57-aea5-d2ed41f7f6a6-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-f10213d6-03ac-4d5d-9bd4-fe68a3235e02" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e1bee-5545-4917-9f1b-6c3e223ab9e8]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:56 devstack sudo[105556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126
Sep 22 15:55:56 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:56 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD
Sep 22 15:55:56 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:57 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02
Sep 22 15:55:57 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:57 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126" returned: 0 in 0.457s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:57 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:57 devstack sudo[105568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126
Sep 22 15:55:57 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:57 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02" returned: 0 in 0.480s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:57 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD
Sep 22 15:55:57 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:57 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02
Sep 22 15:55:57 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:57 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-a981cf4b-51c9-44b9-93a2-69ab192de126" returned: 0 in 0.308s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-a981cf4b-51c9-44b9-93a2-69ab192de126" released by "delete_volume" :: held 0.854s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Created reservations ['72cb07da-9397-4336-a196-eea7b522ba51', '92cc9c00-03e2-4813-8289-7134c9a5ba7d', 'a5f0c17b-0ddb-47dc-840b-ca40fe889b73', '4f90fb23-ed7c-4de8-ba4e-d6b713f9c284'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:57 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD" returned: 1 in 0.429s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f84371-a9f9-49de-8e67-e80ce88db78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b396a7bf9ab450486b28b1312e391c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:55Z,use_quota=True,user_id='0f293d9722da46d7be561653cdb295bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Creating volume 53f84371-a9f9-49de-8e67-e80ce88db78b {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:57 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:57 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f10213d6-03ac-4d5d-9bd4-fe68a3235e02" returned: 0 in 0.344s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:57 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b 1073741824
Sep 22 15:55:57 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-quobyte-f10213d6-03ac-4d5d-9bd4-fe68a3235e02" released by "delete_volume" :: held 0.908s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:57 devstack sudo[105583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:57 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:57 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Created reservations ['c3061420-c5b5-4c2d-ba2c-764af604d19d', '27cf5d8a-3ab1-47df-876c-05d7daf91896', '95bb07a1-ca6f-4c59-a658-ab9d37ff7b94', '888150fd-59d3-41f2-8de0-09420c1d8ae2'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:58 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:55:58 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:58 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.540s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Deleted volume successfully.
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ebf68fc2-5842-48ca-a1d9-541366bebcf8 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-a981cf4b-51c9-44b9-93a2-69ab192de126-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:58 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b 1073741824" returned: 0 in 0.772s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:58 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.509s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:55:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Deleted volume successfully.
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7be65317-d480-4d43-953f-4fd87e01f083 tempest-CreateVolumesFromSourceVolumeTest-1828514058 None] Lock "cinder-f10213d6-03ac-4d5d-9bd4-fe68a3235e02-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:55:58 devstack sudo[105593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b
Sep 22 15:55:58 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (b7a6f34f-00b1-446a-8e62-663a10f96454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90ff233-38c5-4f17-b212-ddc923223f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90ff233-38c5-4f17-b212-ddc923223f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-282908653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974eb9ec-8c39-49d6-aec3-49c62e399290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:59Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f203c649-f083-4933-8a00-3462a375d1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:58 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f203c649-f083-4933-8a00-3462a375d1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e232b5-c14e-45ca-8e8f-fd284cf9f14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e232b5-c14e-45ca-8e8f-fd284cf9f14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974eb9ec-8c39-49d6-aec3-49c62e399290', 'volume_name': 'volume-974eb9ec-8c39-49d6-aec3-49c62e399290', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dd5453-a03d-4f5f-adf9-2a7de857832d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dd5453-a03d-4f5f-adf9-2a7de857832d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2280211a-298f-45ce-aa94-94029c615a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:55:58 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Volume 974eb9ec-8c39-49d6-aec3-49c62e399290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974eb9ec-8c39-49d6-aec3-49c62e399290', 'volume_size': 1}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b" returned: 0 in 0.320s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-282908653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974eb9ec-8c39-49d6-aec3-49c62e399290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:55:59Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Creating volume 974eb9ec-8c39-49d6-aec3-49c62e399290 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:55:58 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:55:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:59 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290 1073741824
Sep 22 15:55:59 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:59 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Attempting download of 7603674b-8f5d-4cc4-9bae-b2be83cbfe21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'metadata': {}}])) to volume 53f84371-a9f9-49de-8e67-e80ce88db78b. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 22 15:55:59 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a25278e-66d6-4744-8ea4-00153fd4aa61]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:55:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_kk0yor5t {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:59 devstack sudo[105599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_kk0yor5t
Sep 22 15:55:59 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:59 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_kk0yor5t" returned: 0 in 0.468s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_kk0yor5t {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:59 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290 1073741824" returned: 0 in 0.597s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:55:59 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290
Sep 22 15:55:59 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:59 devstack sudo[105607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_kk0yor5t
Sep 22 15:55:59 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:55:59 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root
Sep 22 15:55:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_kk0yor5t" returned: 1 in 0.453s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:55:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_kk0yor5t' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ec336-109e-43d3-a843-9f42a8329391]: (4, 'raw') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:00 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290" returned: 0 in 0.411s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2280211a-298f-45ce-aa94-94029c615a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974eb9ec-8c39-49d6-aec3-49c62e399290', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e05d94-1a7b-43d3-96b9-b02cdebfaf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:00 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Volume volume-974eb9ec-8c39-49d6-aec3-49c62e399290 (974eb9ec-8c39-49d6-aec3-49c62e399290): created successfully
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e05d94-1a7b-43d3-96b9-b02cdebfaf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (b7a6f34f-00b1-446a-8e62-663a10f96454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:00 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c8f9389f-3341-4c53-8940-dd1d3923b007 tempest-ProjectMemberTests-1212956627 None] Created volume successfully.
Sep 22 15:56:00 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD
Sep 22 15:56:00 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:00 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:00 devstack sudo[105618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD
Sep 22 15:56:00 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:00 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD' failed. Not Retrying. {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] 7603674b-8f5d-4cc4-9bae-b2be83cbfe21 was raw, converting to qcow2 {{(pid=85987) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:00 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b
Sep 22 15:56:00 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Creating offline snapshot 0b77f88d-6c05-4839-90c9-64c061aef076 of volume 974eb9ec-8c39-49d6-aec3-49c62e399290 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c07a96c-153d-43c6-b4e8-7879392aa810]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:01 devstack sudo[105626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290
Sep 22 15:56:01 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:01 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290" returned: 0 in 0.409s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:01 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b" returned: 0 in 0.560s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7603674b-8f5d-4cc4-9bae-b2be83cbfe21_6b3v44todevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:56:01 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Converted 0.00 MB image at 0.00 MB/s
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:01 devstack sudo[105635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 1G
Sep 22 15:56:01 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:01 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b 1G
Sep 22 15:56:01 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:01 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b 1G" returned: 0 in 0.366s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Downloaded image 7603674b-8f5d-4cc4-9bae-b2be83cbfe21 ((None, [{'url': 'file:///opt/stack/data/glance/images/7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'metadata': {}}])) to volume 53f84371-a9f9-49de-8e67-e80ce88db78b successfully. {{(pid=85987) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Temporary image 7603674b-8f5d-4cc4-9bae-b2be83cbfe21 for user 0f293d9722da46d7be561653cdb295bb is deleted. {{(pid=85987) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.volume.volume_utils [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Marking volume 53f84371-a9f9-49de-8e67-e80ce88db78b as bootable. {{(pid=85987) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Copying metadata from image 7603674b-8f5d-4cc4-9bae-b2be83cbfe21 to 53f84371-a9f9-49de-8e67-e80ce88db78b. {{(pid=85987) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Creating volume glance metadata for volume 53f84371-a9f9-49de-8e67-e80ce88db78b backed by image 7603674b-8f5d-4cc4-9bae-b2be83cbfe21 with: {'image_id': '7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '19244f7c478da9fd4a2b16858f192bad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85987) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b9f5ca-7441-4992-87e0-01697726f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f84371-a9f9-49de-8e67-e80ce88db78b', 'volume_size': 1, 'image_id': '7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19244f7c478da9fd4a2b16858f192bad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b396a7bf9ab450486b28b1312e391c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5505630c6d1d15e713885918ab365b7e5f8009e17f33b4ccdbc7967e4f09d19a27f65da3985d97f565c6d674f9437e00f11a9692244dd57b47cddf9569370125', 'id': '7603674b-8f5d-4cc4-9bae-b2be83cbfe21', 'created_at': datetime.datetime(2026, 9, 22, 13, 55, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 13, 55, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7603674b-8f5d-4cc4-9bae-b2be83cbfe21/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ecd33696c00>}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:01 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8696e2e-5d4e-46ae-ae38-691dd42f08a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 1G" returned: 0 in 0.532s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974eb9ec-8c39-49d6-aec3-49c62e399290 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:01 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Volume volume-53f84371-a9f9-49de-8e67-e80ce88db78b (53f84371-a9f9-49de-8e67-e80ce88db78b): created successfully
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8696e2e-5d4e-46ae-ae38-691dd42f08a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:01 devstack sudo[105647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974eb9ec-8c39-49d6-aec3-49c62e399290 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076
Sep 22 15:56:01 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Flow 'volume_create_manager' (a14f8dcc-257d-4d87-96cc-3b44ae56070e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:01 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c0ddbfb5-15f2-433a-937e-b4f8ac4c5b64 tempest-VolumeImageDependencyTests-1086210875 None] Created volume successfully.
Sep 22 15:56:02 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974eb9ec-8c39-49d6-aec3-49c62e399290 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076" returned: 0 in 0.354s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:02 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 is being set with open permissions: ugo+rw
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:02 devstack sudo[105653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076
Sep 22 15:56:02 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:02 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076" returned: 0 in 0.280s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:02 devstack sudo[105656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.info
Sep 22 15:56:02 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Acquiring lock "cinder-53f84371-a9f9-49de-8e67-e80ce88db78b-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Lock "cinder-53f84371-a9f9-49de-8e67-e80ce88db78b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Acquiring lock "cinder-quobyte-53f84371-a9f9-49de-8e67-e80ce88db78b" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Lock "cinder-quobyte-53f84371-a9f9-49de-8e67-e80ce88db78b" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc379539-91b6-45b8-b14a-3cecb07a67be]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:02 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.info" returned: 0 in 0.350s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:02 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.info is being set with open permissions: ugo+rw
Sep 22 15:56:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:02 devstack sudo[105660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.info
Sep 22 15:56:02 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:03 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b
Sep 22 15:56:03 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:03 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.info" returned: 0 in 0.335s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:03 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-09517558-64af-4140-866c-6d380bc139d5 tempest-ProjectMemberTests-1212956627 None] Create snapshot completed successfully
Sep 22 15:56:03 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b" returned: 0 in 0.488s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:03 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b
Sep 22 15:56:03 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:03 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-53f84371-a9f9-49de-8e67-e80ce88db78b" returned: 0 in 0.278s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Lock "cinder-quobyte-53f84371-a9f9-49de-8e67-e80ce88db78b" released by "delete_volume" :: held 0.833s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Created reservations ['0dd0c921-6020-489e-a8b5-94aa9200d2e4', '33386d80-b389-4330-b544-7b6a49ec74cb', '871b107d-2539-4214-b0ad-91667ddb91a5', 'a52cba4d-58ca-4c6f-a872-56c300bdf832'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:03 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:03 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-0b77f88d-6c05-4839-90c9-64c061aef076-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:04 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.324s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:04 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Deleted volume successfully.
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-0b77f88d-6c05-4839-90c9-64c061aef076-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-974eb9ec-8c39-49d6-aec3-49c62e399290" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-974eb9ec-8c39-49d6-aec3-49c62e399290" acquired by "delete_snapshot" :: waited 0.043s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-0b77f88d-6c05-4839-90c9-64c061aef076" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-289a4d0d-a7c6-4df3-ac9e-d20e97573899 tempest-VolumeImageDependencyTests-1086210875 None] Lock "cinder-53f84371-a9f9-49de-8e67-e80ce88db78b-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-0b77f88d-6c05-4839-90c9-64c061aef076" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Deleting offline snapshot 0b77f88d-6c05-4839-90c9-64c061aef076 of volume 974eb9ec-8c39-49d6-aec3-49c62e399290 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] snapshot_file for this snap is: volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70c0224-7067-418a-8bb8-c42575f19ffa]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:04 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076
Sep 22 15:56:04 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:04 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076" returned: 0 in 0.432s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-974eb9ec-8c39-49d6-aec3-49c62e399290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d63fb35-1f37-4601-99ef-1402a287206c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:04 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290
Sep 22 15:56:04 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:05 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290" returned: 0 in 0.546s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:05 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076
Sep 22 15:56:05 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:05 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076" returned: 0 in 0.559s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:05 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076
Sep 22 15:56:05 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:06 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290.0b77f88d-6c05-4839-90c9-64c061aef076" returned: 0 in 0.347s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-0b77f88d-6c05-4839-90c9-64c061aef076" released by "_delete_snapshot" :: held 2.040s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-974eb9ec-8c39-49d6-aec3-49c62e399290" released by "delete_snapshot" :: held 2.080s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:06 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Created reservations ['743d7982-22cb-4db3-b3d0-8ce2e5a25c08', '2e0e595c-8ca0-4dfa-b491-d3a011dc6237', '4e0201a5-ce7e-41ad-9049-c8a26596bfbd', '267740e1-de5f-42f3-9021-7078a1659e78'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Delete snapshot completed successfully.
Sep 22 15:56:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f8794108-02cf-4ec6-aa4a-20f0af88a531 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-0b77f88d-6c05-4839-90c9-64c061aef076-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-974eb9ec-8c39-49d6-aec3-49c62e399290-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-974eb9ec-8c39-49d6-aec3-49c62e399290-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-974eb9ec-8c39-49d6-aec3-49c62e399290" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-974eb9ec-8c39-49d6-aec3-49c62e399290" acquired by "delete_volume" :: waited 0.031s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:07 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[df175c7f-c0fa-48c2-b41b-8f8fb56c424e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:07 devstack sudo[105695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290
Sep 22 15:56:07 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:08 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290" returned: 0 in 0.476s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:08 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290
Sep 22 15:56:08 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Flow 'volume_create_manager' (5b2d9cfd-ab71-4d89-8778-b36019f96480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae54994-6eee-417e-86d2-b2dedabc67e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae54994-6eee-417e-86d2-b2dedabc67e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df90e11-ec7b-4d9b-ae4b-1cb3054c6830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c2b59b32c481e8d9863ffc85cfeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:08Z,use_quota=True,user_id='db1f166dbb3642599eb0356d7a4166ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:08 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dade9d92-6b41-4d99-b3ba-3f9df2b6514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dade9d92-6b41-4d99-b3ba-3f9df2b6514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7978c8-2141-4214-8f1a-974aa118ef8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7978c8-2141-4214-8f1a-974aa118ef8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df90e11-ec7b-4d9b-ae4b-1cb3054c6830', 'volume_name': 'volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87710c16-529a-4660-9a2e-a7bd661c676a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87710c16-529a-4660-9a2e-a7bd661c676a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3d1353-a297-40db-a8f4-4303a8202d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:08 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Volume 6df90e11-ec7b-4d9b-ae4b-1cb3054c6830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830', 'volume_size': 1}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df90e11-ec7b-4d9b-ae4b-1cb3054c6830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c2b59b32c481e8d9863ffc85cfeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:08Z,use_quota=True,user_id='db1f166dbb3642599eb0356d7a4166ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Creating volume 6df90e11-ec7b-4d9b-ae4b-1cb3054c6830 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:08 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-974eb9ec-8c39-49d6-aec3-49c62e399290" returned: 0 in 0.379s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:08 devstack sudo[105703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830 1073741824
Sep 22 15:56:08 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-974eb9ec-8c39-49d6-aec3-49c62e399290" released by "delete_volume" :: held 0.945s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Created reservations ['ff8fba5a-3bfb-463a-99ef-3346a7079ba7', '977de196-4059-41aa-9952-240a83508310', '063e430a-aee0-492a-a6a9-97135bbe422b', '15eaa067-46a8-40f3-a28a-9a2a60e2cc7e'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:08 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:08 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:09 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.354s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:09 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Deleted volume successfully.
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d488d99c-5d64-4ca6-8153-4339318103e6 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-974eb9ec-8c39-49d6-aec3-49c62e399290-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:09 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830 1073741824" returned: 0 in 0.673s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:09 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830
Sep 22 15:56:09 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:09 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830" returned: 0 in 0.339s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=262,cinder:SELECT=218,cinder:INSERT=83,cinder:DELETE=28 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3d1353-a297-40db-a8f4-4303a8202d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12c4e5d-661d-42c8-83ac-1fdc7ba25187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (2a163165-bbd3-434b-88b7-0f1354e94b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6eb3222-4d45-4719-b50d-3ae4b3c19c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Volume volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830 (6df90e11-ec7b-4d9b-ae4b-1cb3054c6830): created successfully
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12c4e5d-661d-42c8-83ac-1fdc7ba25187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Flow 'volume_create_manager' (5b2d9cfd-ab71-4d89-8778-b36019f96480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6eb3222-4d45-4719-b50d-3ae4b3c19c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659645893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bddceb8-5877-4cbe-be04-bee68d2f8bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:10Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82eb4a21-6252-4308-90bb-68cbecee20f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82eb4a21-6252-4308-90bb-68cbecee20f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f7c4d9-2d3e-425f-bc8a-3aa18fdd4b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f7c4d9-2d3e-425f-bc8a-3aa18fdd4b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bddceb8-5877-4cbe-be04-bee68d2f8bdc', 'volume_name': 'volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5924718-f488-4ddc-a2d6-bb11d58fc084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5924718-f488-4ddc-a2d6-bb11d58fc084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ca1851-c4cb-4db4-bcf8-19174dc46791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Volume 3bddceb8-5877-4cbe-be04-bee68d2f8bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc', 'volume_size': 1}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659645893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bddceb8-5877-4cbe-be04-bee68d2f8bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:10Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Creating volume 3bddceb8-5877-4cbe-be04-bee68d2f8bdc {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:09 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:09 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-42030539-9bb0-4624-b6ca-b98c894591fc tempest-CinderUnicodeTest-521031468 None] Created volume successfully.
Sep 22 15:56:09 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc 1073741824
Sep 22 15:56:09 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (ef6fc1a0-0a76-4202-9b71-89c476d25e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b51dd17-28b7-44ae-b6a7-8f790bfde6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b51dd17-28b7-44ae-b6a7-8f790bfde6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057624174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c175c45d-b39e-4cc7-9e0c-149d976a3cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:10Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef610b99-76c8-4571-a374-952c96f43e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef610b99-76c8-4571-a374-952c96f43e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b736f4-9171-4175-b224-35d884a6f3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b736f4-9171-4175-b224-35d884a6f3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c175c45d-b39e-4cc7-9e0c-149d976a3cda', 'volume_name': 'volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6275e7d-c89e-4716-ba75-b992161d1297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6275e7d-c89e-4716-ba75-b992161d1297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b369a86d-53e7-4683-8871-3575d9ceb921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:09 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Volume c175c45d-b39e-4cc7-9e0c-149d976a3cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda', 'volume_size': 1}
Sep 22 15:56:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:10 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc 1073741824" returned: 0 in 0.529s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=209,cinder:UPDATE=315,cinder:DELETE=23,cinder:INSERT=72 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:10 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc
Sep 22 15:56:10 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:10 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" returned: 0 in 0.260s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057624174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c175c45d-b39e-4cc7-9e0c-149d976a3cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:10Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Creating volume c175c45d-b39e-4cc7-9e0c-149d976a3cda {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:10 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:10 devstack sudo[105726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda 1073741824
Sep 22 15:56:10 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ca1851-c4cb-4db4-bcf8-19174dc46791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e460ddc-0e15-4e17-870e-1681d6e6b8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:10 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Volume volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc (3bddceb8-5877-4cbe-be04-bee68d2f8bdc): created successfully
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e460ddc-0e15-4e17-870e-1681d6e6b8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (2a163165-bbd3-434b-88b7-0f1354e94b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-155080b8-8171-4151-8e34-df06d077ed85 tempest-ProjectReaderTests-968238754 None] Created volume successfully.
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:11 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Flow 'volume_create_manager' (5671880b-06fa-403a-8ae2-81cf77f03a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1503320-6d93-4ef0-8845-ce875bacfaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda 1073741824" returned: 0 in 0.504s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1503320-6d93-4ef0-8845-ce875bacfaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1022019621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09b7513-92ce-4d47-8559-7f6f80c42c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c2b59b32c481e8d9863ffc85cfeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:11Z,use_quota=True,user_id='db1f166dbb3642599eb0356d7a4166ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fbeba1-021f-4f49-a170-e4b85352f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fbeba1-021f-4f49-a170-e4b85352f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877cb32b-4dab-4501-8225-b78bba0edd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877cb32b-4dab-4501-8225-b78bba0edd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09b7513-92ce-4d47-8559-7f6f80c42c81', 'volume_name': 'volume-e09b7513-92ce-4d47-8559-7f6f80c42c81', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa09f948-82ce-4d98-b778-adc1bcec3557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa09f948-82ce-4d98-b778-adc1bcec3557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0414063-8d27-4b08-9ac1-ead45f3a02f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:11 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Volume e09b7513-92ce-4d47-8559-7f6f80c42c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09b7513-92ce-4d47-8559-7f6f80c42c81', 'volume_size': 1}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:11 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda
Sep 22 15:56:11 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:11 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda" returned: 0 in 0.256s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1022019621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09b7513-92ce-4d47-8559-7f6f80c42c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c2b59b32c481e8d9863ffc85cfeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:11Z,use_quota=True,user_id='db1f166dbb3642599eb0356d7a4166ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Creating volume e09b7513-92ce-4d47-8559-7f6f80c42c81 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:11 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b369a86d-53e7-4683-8871-3575d9ceb921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d749d5-fb3e-462f-affd-02802ab16a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:11 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 1073741824
Sep 22 15:56:11 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:11 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Volume volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda (c175c45d-b39e-4cc7-9e0c-149d976a3cda): created successfully
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d749d5-fb3e-462f-affd-02802ab16a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:11 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (ef6fc1a0-0a76-4202-9b71-89c476d25e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:11 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4f8f08ee-21c9-45b2-a16f-d9fdb8c9e22f tempest-ProjectMemberTests-1212956627 None] Created volume successfully.
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:12 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 1073741824" returned: 0 in 0.626s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:12 devstack sudo[105741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81
Sep 22 15:56:12 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:12 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81" returned: 0 in 0.255s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.394s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Creating offline snapshot bd6dee8e-fdae-4448-9327-642ef2083710 of volume 3bddceb8-5877-4cbe-be04-bee68d2f8bdc {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0414063-8d27-4b08-9ac1-ead45f3a02f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09b7513-92ce-4d47-8559-7f6f80c42c81', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a7901b-bfe2-4df5-80e6-a44d525761c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5474278e-75e2-4870-b3fd-bb1305f81071]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:12 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Volume volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 (e09b7513-92ce-4d47-8559-7f6f80c42c81): created successfully
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a7901b-bfe2-4df5-80e6-a44d525761c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Flow 'volume_create_manager' (5671880b-06fa-403a-8ae2-81cf77f03a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:12 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-056a385f-0842-4ee9-b747-8d6fc246db6e tempest-CinderUnicodeTest-521031468 None] Created volume successfully.
Sep 22 15:56:12 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc
Sep 22 15:56:12 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:12 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" returned: 0 in 0.421s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:12 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 1G
Sep 22 15:56:12 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:13 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 1G" returned: 0 in 0.527s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:13 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710
Sep 22 15:56:13 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:13 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710" returned: 0 in 0.340s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:13 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 is being set with open permissions: ugo+rw
Sep 22 15:56:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:13 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710
Sep 22 15:56:13 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:14 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710" returned: 0 in 0.257s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:14 devstack sudo[105799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.info
Sep 22 15:56:14 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:14 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.info" returned: 0 in 0.261s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:14 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.info is being set with open permissions: ugo+rw
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:14 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.info
Sep 22 15:56:14 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:14 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.info" returned: 0 in 0.262s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.519s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Creating offline snapshot 88c0c56c-cd12-4063-8cc1-2c24da69c896 of volume c175c45d-b39e-4cc7-9e0c-149d976a3cda {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7ae89332-7fb3-499a-9828-fe7ba10c7829 tempest-ProjectReaderTests-968238754 None] Create snapshot completed successfully
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f36c78d-9e1f-4cc5-ad76-e590c328d4cf]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:14 devstack sudo[105805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda
Sep 22 15:56:14 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:15 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda" returned: 0 in 0.406s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:15 devstack sudo[105810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 1G
Sep 22 15:56:15 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-bd6dee8e-fdae-4448-9327-642ef2083710-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Lock "cinder-bd6dee8e-fdae-4448-9327-642ef2083710-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-bd6dee8e-fdae-4448-9327-642ef2083710" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-bd6dee8e-fdae-4448-9327-642ef2083710" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Deleting offline snapshot bd6dee8e-fdae-4448-9327-642ef2083710 of volume 3bddceb8-5877-4cbe-be04-bee68d2f8bdc {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] snapshot_file for this snap is: volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7677a4bd-64ee-4e02-9632-35a9cd91d67b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:15 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 1G" returned: 0 in 0.462s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:15 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896
Sep 22 15:56:15 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:15 devstack sudo[105816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710
Sep 22 15:56:15 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:15 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896" returned: 0 in 0.307s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:15 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 is being set with open permissions: ugo+rw
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:15 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896
Sep 22 15:56:15 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:15 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710" returned: 0 in 0.397s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[242905b3-5267-4821-addd-6420f164fd07]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:16 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc
Sep 22 15:56:16 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:16 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896" returned: 0 in 0.321s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:16 devstack sudo[105832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.info
Sep 22 15:56:16 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:16 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" returned: 0 in 0.384s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:16 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710
Sep 22 15:56:16 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:16 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.info" returned: 0 in 0.259s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:16 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.info is being set with open permissions: ugo+rw
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:16 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.info
Sep 22 15:56:16 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:16 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.info" returned: 0 in 0.268s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:16 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.181s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710" returned: 0 in 0.398s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Creating offline snapshot e124d163-004f-4114-b6b4-a6f0e4132fe0 of volume e09b7513-92ce-4d47-8559-7f6f80c42c81 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:16 devstack sudo[105846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710
Sep 22 15:56:16 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7efb7056-2559-44fe-b126-3cdf0ff9e595 tempest-ProjectMemberTests-1212956627 None] Create snapshot completed successfully
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cec0c47-754b-4f9c-a13e-5f684e6ae44a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:16 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81
Sep 22 15:56:16 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:16 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc.bd6dee8e-fdae-4448-9327-642ef2083710" returned: 0 in 0.261s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-bd6dee8e-fdae-4448-9327-642ef2083710" released by "_delete_snapshot" :: held 1.575s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" released by "delete_snapshot" :: held 1.598s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Created reservations ['5474e489-13cf-4f1e-882f-331aa3881d79', '10f0f550-08a1-4b03-918c-c0078efe2d10', '524d84c5-cb01-48cd-b93e-212d4dc4a7a1', 'ee9381be-0afe-46b0-8070-dacace1036d1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Delete snapshot completed successfully.
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-ca67cf3b-73f1-45c4-89f0-6ba2ee41a73d tempest-ProjectReaderTests-968238754 None] Lock "cinder-bd6dee8e-fdae-4448-9327-642ef2083710-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:17 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81" returned: 0 in 0.420s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:17 devstack sudo[105855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 1G
Sep 22 15:56:17 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-88c0c56c-cd12-4063-8cc1-2c24da69c896-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Lock "cinder-88c0c56c-cd12-4063-8cc1-2c24da69c896-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-c175c45d-b39e-4cc7-9e0c-149d976a3cda" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-c175c45d-b39e-4cc7-9e0c-149d976a3cda" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-88c0c56c-cd12-4063-8cc1-2c24da69c896" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-88c0c56c-cd12-4063-8cc1-2c24da69c896" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Deleting offline snapshot 88c0c56c-cd12-4063-8cc1-2c24da69c896 of volume c175c45d-b39e-4cc7-9e0c-149d976a3cda {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] snapshot_file for this snap is: volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd8a628-213e-493f-b831-c8dfe57acdde]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:17 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896
Sep 22 15:56:17 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-3bddceb8-5877-4cbe-be04-bee68d2f8bdc-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Lock "cinder-3bddceb8-5877-4cbe-be04-bee68d2f8bdc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:17 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 1G" returned: 0 in 0.511s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6526bae-ef6c-4159-a40d-b9d21b0d4dac]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:17 devstack sudo[105866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0
Sep 22 15:56:17 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:17 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896" returned: 0 in 0.424s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedeb79b-9c16-4af6-84dc-884418515c4e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:17 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc
Sep 22 15:56:17 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:17 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda
Sep 22 15:56:17 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:18 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0" returned: 0 in 0.312s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:18 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 is being set with open permissions: ugo+rw
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:18 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0
Sep 22 15:56:18 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:18 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" returned: 0 in 0.439s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:18 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc
Sep 22 15:56:18 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:18 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda" returned: 0 in 0.421s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:18 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896
Sep 22 15:56:18 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:18 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0" returned: 0 in 0.308s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:18 devstack sudo[105890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.info
Sep 22 15:56:18 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:18 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" returned: 0 in 0.284s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-3bddceb8-5877-4cbe-be04-bee68d2f8bdc" released by "delete_volume" :: held 0.800s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:18 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896" returned: 0 in 0.368s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Created reservations ['9261135e-da27-445d-af90-a91ece8cf851', '698da908-b083-4580-a6e0-9ea45ce34c4f', 'ac19fe3d-2297-45fd-a4c4-3f28291dcf41', 'c1713182-6928-41ba-960c-afb13bcef7b1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:18 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896
Sep 22 15:56:18 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:18 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.info" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:18 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.info is being set with open permissions: ugo+rw
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:18 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.info
Sep 22 15:56:18 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:18 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:18 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:18 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda.88c0c56c-cd12-4063-8cc1-2c24da69c896" returned: 0 in 0.309s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-88c0c56c-cd12-4063-8cc1-2c24da69c896" released by "_delete_snapshot" :: held 1.647s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-c175c45d-b39e-4cc7-9e0c-149d976a3cda" released by "delete_snapshot" :: held 1.681s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:18 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.info" returned: 0 in 0.328s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:19 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-11cb77da-2247-4821-9a66-75ca0e56cdc2 tempest-CinderUnicodeTest-521031468 None] Create snapshot completed successfully
Sep 22 15:56:19 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Created reservations ['84892e5e-b6a7-444c-ae3c-b7cb87924924', '3e5372dc-cd19-47d5-8279-cf76c58f8439', '6a7d4d31-62db-45bc-bf46-f5f88ee17e62', '35dd3177-ce63-4b23-896c-936b3c05be2c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.310s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:19 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Deleted volume successfully.
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c734b89f-e8e7-4e8f-8484-2b08f0885274 tempest-ProjectReaderTests-968238754 None] Lock "cinder-3bddceb8-5877-4cbe-be04-bee68d2f8bdc-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:19 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Delete snapshot completed successfully.
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4d916644-7556-4db0-9ca7-87fd68e7f90a tempest-ProjectMemberTests-1212956627 None] Lock "cinder-88c0c56c-cd12-4063-8cc1-2c24da69c896-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (819d8427-9e21-4985-8c27-da3865a24aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2dcab1-3462-4375-88b5-06cf849d1b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2dcab1-3462-4375-88b5-06cf849d1b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874527983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f602ddb2-872b-4e7c-8d4d-a740d08c8222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:19Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57e3def-1c9d-46bf-9c56-5241a5f342e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57e3def-1c9d-46bf-9c56-5241a5f342e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3726ce60-9b37-4c93-9fa5-e7e1417f787a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3726ce60-9b37-4c93-9fa5-e7e1417f787a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f602ddb2-872b-4e7c-8d4d-a740d08c8222', 'volume_name': 'volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8810e337-69b0-415a-a1e7-da3820333545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8810e337-69b0-415a-a1e7-da3820333545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1aa78e2-6836-4cb2-8edf-e4893da5a3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:19 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Volume f602ddb2-872b-4e7c-8d4d-a740d08c8222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222', 'volume_size': 1}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874527983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f602ddb2-872b-4e7c-8d4d-a740d08c8222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:19Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Creating volume f602ddb2-872b-4e7c-8d4d-a740d08c8222 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:19 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-c175c45d-b39e-4cc7-9e0c-149d976a3cda-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:19 devstack sudo[105906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 1073741824
Sep 22 15:56:19 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-c175c45d-b39e-4cc7-9e0c-149d976a3cda-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-c175c45d-b39e-4cc7-9e0c-149d976a3cda" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-c175c45d-b39e-4cc7-9e0c-149d976a3cda" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b3eedb-86f7-48b7-ad23-166edfa7db8e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:19 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda
Sep 22 15:56:19 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:19 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Acquiring lock "cinder-e124d163-004f-4114-b6b4-a6f0e4132fe0-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 1073741824" returned: 0 in 0.470s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Lock "cinder-e124d163-004f-4114-b6b4-a6f0e4132fe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Acquiring lock "cinder-quobyte-e09b7513-92ce-4d47-8559-7f6f80c42c81" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Lock "cinder-quobyte-e09b7513-92ce-4d47-8559-7f6f80c42c81" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Acquiring lock "cinder-quobyte-e124d163-004f-4114-b6b4-a6f0e4132fe0" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Lock "cinder-quobyte-e124d163-004f-4114-b6b4-a6f0e4132fe0" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Deleting offline snapshot e124d163-004f-4114-b6b4-a6f0e4132fe0 of volume e09b7513-92ce-4d47-8559-7f6f80c42c81 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:19 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:19 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222
Sep 22 15:56:19 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] snapshot_file for this snap is: volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda" returned: 0 in 0.451s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c958fb8-7eb4-4280-aa9f-4f5c79528177]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:20 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda
Sep 22 15:56:20 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:20 devstack sudo[105920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0
Sep 22 15:56:20 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:20 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222" returned: 0 in 0.286s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1aa78e2-6836-4cb2-8edf-e4893da5a3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa34d45-7cc9-44f9-a385-0d8a99061069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:20 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Volume volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 (f602ddb2-872b-4e7c-8d4d-a740d08c8222): created successfully
Sep 22 15:56:20 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa34d45-7cc9-44f9-a385-0d8a99061069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (819d8427-9e21-4985-8c27-da3865a24aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-c175c45d-b39e-4cc7-9e0c-149d976a3cda" returned: 0 in 0.302s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-12890222-a296-45c7-985b-c2cf27cba9d2 tempest-ProjectReaderTests-968238754 None] Created volume successfully.
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-c175c45d-b39e-4cc7-9e0c-149d976a3cda" released by "delete_volume" :: held 0.830s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Created reservations ['a005919a-acae-4a27-a7cb-ef636d7422da', '2ddc401d-3337-4831-8743-e12c44a6c77b', '0e18b42c-f3ba-4a51-8937-cb6fbeccf141', '56d25bc6-ad47-4918-89d2-f37011b37cec'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:20 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0" returned: 0 in 0.434s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e09b7513-92ce-4d47-8559-7f6f80c42c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:20 devstack sudo[105928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:20 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[38299c6e-19db-42d4-8496-91024321e14c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:20 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81
Sep 22 15:56:20 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:20 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.261s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:20 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Deleted volume successfully.
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e54e250e-0e01-45ec-86ed-6138c0469fe6 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-c175c45d-b39e-4cc7-9e0c-149d976a3cda-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:20 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81" returned: 0 in 0.416s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:20 devstack sudo[105937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0
Sep 22 15:56:20 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (dec6e54e-431a-47da-8038-07639bbdba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b00ea3-cd1b-4993-a233-69b21f4cf1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b00ea3-cd1b-4993-a233-69b21f4cf1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-978443587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ef0ee3-80fc-49be-8547-17abaad957c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:21Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6b8bbf-cbfc-4308-8f8d-fb1ae69c0d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6b8bbf-cbfc-4308-8f8d-fb1ae69c0d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa23b04-8511-4c6a-836e-13cba8fe2617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa23b04-8511-4c6a-836e-13cba8fe2617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40ef0ee3-80fc-49be-8547-17abaad957c4', 'volume_name': 'volume-40ef0ee3-80fc-49be-8547-17abaad957c4', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4d992c-0f81-4aa7-880e-6709a465f83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4d992c-0f81-4aa7-880e-6709a465f83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddbb689-d63d-4078-9bc2-71208ed1df80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:21 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Volume 40ef0ee3-80fc-49be-8547-17abaad957c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40ef0ee3-80fc-49be-8547-17abaad957c4', 'volume_size': 1}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-978443587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ef0ee3-80fc-49be-8547-17abaad957c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:21Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Creating volume 40ef0ee3-80fc-49be-8547-17abaad957c4 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:21 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:21 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4 1073741824
Sep 22 15:56:21 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:21 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0" returned: 0 in 0.397s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:21 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0
Sep 22 15:56:21 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:21 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81.e124d163-004f-4114-b6b4-a6f0e4132fe0" returned: 0 in 0.299s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Lock "cinder-quobyte-e124d163-004f-4114-b6b4-a6f0e4132fe0" released by "_delete_snapshot" :: held 1.690s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Lock "cinder-quobyte-e09b7513-92ce-4d47-8559-7f6f80c42c81" released by "delete_snapshot" :: held 1.729s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:21 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4 1073741824" returned: 0 in 0.504s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Created reservations ['2a3d1236-7bd7-4278-a132-a3134cf74c98', '83b92c13-62e7-415b-af8f-bca47f7cf480', 'dad3aeea-c195-4f6b-966e-4d8a959431f8', '94177a5d-feff-4fb5-8a1b-61699593deab'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:21 devstack sudo[105952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4
Sep 22 15:56:21 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:21 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Delete snapshot completed successfully.
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-2bd9eb1b-eafa-4598-a913-0920247e2a0c tempest-CinderUnicodeTest-521031468 None] Lock "cinder-e124d163-004f-4114-b6b4-a6f0e4132fe0-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:21 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4" returned: 0 in 0.259s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:21 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.327s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddbb689-d63d-4078-9bc2-71208ed1df80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ef0ee3-80fc-49be-8547-17abaad957c4', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8420e74d-2e87-4b7a-8e5f-b6aef3eae5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Creating offline snapshot 61814304-2d7b-4409-9625-7c224ec2b672 of volume f602ddb2-872b-4e7c-8d4d-a740d08c8222 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:22 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Volume volume-40ef0ee3-80fc-49be-8547-17abaad957c4 (40ef0ee3-80fc-49be-8547-17abaad957c4): created successfully
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8420e74d-2e87-4b7a-8e5f-b6aef3eae5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (dec6e54e-431a-47da-8038-07639bbdba8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2d3d98-8a5a-4e35-90fc-f75ae2af4faa]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Acquiring lock "cinder-e09b7513-92ce-4d47-8559-7f6f80c42c81-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:22 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0c83db1e-3a32-49d8-82a9-7c1406d14adf tempest-ProjectMemberTests-1212956627 None] Created volume successfully.
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Lock "cinder-e09b7513-92ce-4d47-8559-7f6f80c42c81-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Acquiring lock "cinder-quobyte-e09b7513-92ce-4d47-8559-7f6f80c42c81" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Lock "cinder-quobyte-e09b7513-92ce-4d47-8559-7f6f80c42c81" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[898a847c-de07-45db-a872-23a3fd879db1]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:22 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222
Sep 22 15:56:22 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:22 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81
Sep 22 15:56:22 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:22 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222" returned: 0 in 0.411s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:22 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 1G
Sep 22 15:56:22 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:22 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81" returned: 0 in 0.395s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:22 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81
Sep 22 15:56:22 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:22 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-e09b7513-92ce-4d47-8559-7f6f80c42c81" returned: 0 in 0.288s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:22 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 1G" returned: 0 in 0.438s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Lock "cinder-quobyte-e09b7513-92ce-4d47-8559-7f6f80c42c81" released by "delete_volume" :: held 0.767s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:22 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672
Sep 22 15:56:22 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:22 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Created reservations ['0772c4be-9b99-48dd-b418-f2250359521a', '0afc6f2d-6e28-462c-86e7-222c0c9e612b', '0fed589c-50e5-49b1-99d2-0f2779262ee2', '878a2c1e-c5b2-4a3b-b8ce-bd8e551522b8'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:23 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:23 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Acquiring lock "cinder-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Lock "cinder-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:23 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672" returned: 0 in 0.406s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:23 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 is being set with open permissions: ugo+rw
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Acquiring lock "cinder-quobyte-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Lock "cinder-quobyte-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830" acquired by "delete_volume" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:23 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672
Sep 22 15:56:23 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeeb46b-c5dd-4f73-b952-8afe46fe9c19]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:23 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.372s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:23 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Deleted volume successfully.
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8a18c2a5-e991-4d91-aa8c-a30054a7c6d6 tempest-CinderUnicodeTest-521031468 None] Lock "cinder-e09b7513-92ce-4d47-8559-7f6f80c42c81-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:23 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830
Sep 22 15:56:23 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:23 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672" returned: 0 in 0.321s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:23 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.info
Sep 22 15:56:23 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:23 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830" returned: 0 in 0.380s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:23 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830
Sep 22 15:56:23 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:23 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.info" returned: 0 in 0.261s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:23 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.info is being set with open permissions: ugo+rw
Sep 22 15:56:23 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:23 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.info
Sep 22 15:56:23 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:24 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830" returned: 0 in 0.253s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Lock "cinder-quobyte-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830" released by "delete_volume" :: held 0.684s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Created reservations ['40c60b5a-8f4b-4ad5-a457-f551957b498d', '07839ab6-6200-41d9-99d5-4be34168a822', '23bffbb4-0e2e-4b93-a65a-99a6de0054b8', '2469a372-499e-4764-9bb1-4c3e09097800'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:24 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.info" returned: 0 in 0.259s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.780s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:24 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Creating offline snapshot d8636994-dc16-4673-8ddc-adb631272ae0 of volume 40ef0ee3-80fc-49be-8547-17abaad957c4 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:24 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:24 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0ae1b35e-1820-40d5-ab16-883f58584d4c tempest-ProjectReaderTests-968238754 None] Create snapshot completed successfully
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddfbd39-a924-4160-b680-02a2113e0237]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:24 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4
Sep 22 15:56:24 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:24 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.258s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:24 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Deleted volume successfully.
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04d503f6-c667-4b09-8d4d-9c13e7644d3f tempest-CinderUnicodeTest-521031468 None] Lock "cinder-6df90e11-ec7b-4d9b-ae4b-1cb3054c6830-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:24 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4" returned: 0 in 0.380s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:24 devstack sudo[106012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 1G
Sep 22 15:56:24 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-61814304-2d7b-4409-9625-7c224ec2b672-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Lock "cinder-61814304-2d7b-4409-9625-7c224ec2b672-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-f602ddb2-872b-4e7c-8d4d-a740d08c8222" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-f602ddb2-872b-4e7c-8d4d-a740d08c8222" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-61814304-2d7b-4409-9625-7c224ec2b672" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-61814304-2d7b-4409-9625-7c224ec2b672" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Deleting offline snapshot 61814304-2d7b-4409-9625-7c224ec2b672 of volume f602ddb2-872b-4e7c-8d4d-a740d08c8222 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] snapshot_file for this snap is: volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4bb8b5-6dde-40e1-a454-87ae47eb718d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:24 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:25 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672
Sep 22 15:56:25 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:25 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 1G" returned: 0 in 0.543s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40ef0ee3-80fc-49be-8547-17abaad957c4 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:25 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40ef0ee3-80fc-49be-8547-17abaad957c4 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0
Sep 22 15:56:25 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:25 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672" returned: 0 in 0.458s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0566d59-847b-4fa3-917c-084210fe6f4f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:25 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222
Sep 22 15:56:25 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:25 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40ef0ee3-80fc-49be-8547-17abaad957c4 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0" returned: 0 in 0.374s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:25 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 is being set with open permissions: ugo+rw
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:25 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0
Sep 22 15:56:25 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:25 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222" returned: 0 in 0.406s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:25 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672
Sep 22 15:56:25 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:25 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0" returned: 0 in 0.314s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:25 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:25 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.info
Sep 22 15:56:25 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:26 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.info" returned: 0 in 0.300s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:26 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.info is being set with open permissions: ugo+rw
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:26 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672" returned: 0 in 0.436s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:26 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.info
Sep 22 15:56:26 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:26 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672
Sep 22 15:56:26 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:26 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.info" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:26 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222.61814304-2d7b-4409-9625-7c224ec2b672" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-61814304-2d7b-4409-9625-7c224ec2b672" released by "_delete_snapshot" :: held 1.725s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-f602ddb2-872b-4e7c-8d4d-a740d08c8222" released by "delete_snapshot" :: held 1.756s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:26 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-5380344e-71e7-4285-847e-929860e85670 tempest-ProjectMemberTests-1212956627 None] Create snapshot completed successfully
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Created reservations ['b2937cf1-6f96-40e9-a0fa-ba370206ad52', 'bd1c20dd-7aa8-417c-8678-a70d439573d5', 'ac78caba-3463-4ec1-8a1d-100911a3db07', '58163608-5bd4-4ab2-a720-ce7a6d7b4249'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:26 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Delete snapshot completed successfully.
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-a8ab301e-febe-4422-91ab-c7ad6abfb6e3 tempest-ProjectReaderTests-968238754 None] Lock "cinder-61814304-2d7b-4409-9625-7c224ec2b672-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-f602ddb2-872b-4e7c-8d4d-a740d08c8222-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:26 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Lock "cinder-f602ddb2-872b-4e7c-8d4d-a740d08c8222-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-f602ddb2-872b-4e7c-8d4d-a740d08c8222" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-f602ddb2-872b-4e7c-8d4d-a740d08c8222" acquired by "delete_volume" :: waited 0.014s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b9c33b-0ff5-4059-a726-48d1d4ba502c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:27 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222
Sep 22 15:56:27 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:27 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222" returned: 0 in 0.359s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:27 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222
Sep 22 15:56:27 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-d8636994-dc16-4673-8ddc-adb631272ae0-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-d8636994-dc16-4673-8ddc-adb631272ae0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-40ef0ee3-80fc-49be-8547-17abaad957c4" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-40ef0ee3-80fc-49be-8547-17abaad957c4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-d8636994-dc16-4673-8ddc-adb631272ae0" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d8636994-dc16-4673-8ddc-adb631272ae0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Deleting offline snapshot d8636994-dc16-4673-8ddc-adb631272ae0 of volume 40ef0ee3-80fc-49be-8547-17abaad957c4 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] snapshot_file for this snap is: volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d35af1-b7f4-4fa6-a25e-624e031a65a7]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:27 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f602ddb2-872b-4e7c-8d4d-a740d08c8222" returned: 0 in 0.264s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-f602ddb2-872b-4e7c-8d4d-a740d08c8222" released by "delete_volume" :: held 0.683s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Created reservations ['72068533-2749-43c6-89c3-b035d882d52e', 'b9e4b1be-22ba-4322-ae6e-3824f1c02f19', '09bb46ab-10a2-4260-925f-5eb987c886fe', 'fa8070f7-9e7c-4160-8d4c-3ee0769784d1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:27 devstack sudo[106059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0
Sep 22 15:56:27 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:27 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:27 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:28 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0" returned: 0 in 0.377s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40ef0ee3-80fc-49be-8547-17abaad957c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:28 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8b44fc-26bb-4d9b-bfa1-19541655c0a9]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.288s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:28 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Deleted volume successfully.
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-e76bccfe-3add-412a-8a8b-6cb51b598793 tempest-ProjectReaderTests-968238754 None] Lock "cinder-f602ddb2-872b-4e7c-8d4d-a740d08c8222-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:28 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4
Sep 22 15:56:28 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:28 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4" returned: 0 in 0.382s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:28 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0
Sep 22 15:56:28 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (11c1882b-1bf0-4f65-9488-0958d6c52065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098e4f50-5bac-4d59-8a0f-e62abc882e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098e4f50-5bac-4d59-8a0f-e62abc882e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661650285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c22489-ae5a-45d5-b9e5-4230a40d44c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:29Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aec0122-80e7-4211-8b21-8640bfb6dce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aec0122-80e7-4211-8b21-8640bfb6dce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6cd613-f993-41d8-93c2-86dd89b08a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6cd613-f993-41d8-93c2-86dd89b08a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c22489-ae5a-45d5-b9e5-4230a40d44c8', 'volume_name': 'volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b797f2d3-3c5e-4aa2-ad15-a2f2220281b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b797f2d3-3c5e-4aa2-ad15-a2f2220281b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd2ec71-b995-4377-ab15-df7a4da594d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:28 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Volume 87c22489-ae5a-45d5-b9e5-4230a40d44c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8', 'volume_size': 1}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661650285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c22489-ae5a-45d5-b9e5-4230a40d44c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:29Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Creating volume 87c22489-ae5a-45d5-b9e5-4230a40d44c8 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:28 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:28 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 1073741824
Sep 22 15:56:28 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:28 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:28 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:28 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0" returned: 0 in 0.402s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:28 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0
Sep 22 15:56:28 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:29 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 29 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>, <Thread(Rabbit-heartbeat, started daemon 139419795786048)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:56:29 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4.d8636994-dc16-4673-8ddc-adb631272ae0" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:29 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 1073741824" returned: 0 in 0.479s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d8636994-dc16-4673-8ddc-adb631272ae0" released by "_delete_snapshot" :: held 1.560s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-40ef0ee3-80fc-49be-8547-17abaad957c4" released by "delete_snapshot" :: held 1.589s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:29 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8
Sep 22 15:56:29 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Created reservations ['2fb5df14-98a4-494a-91d4-acfd78263ce5', '6f7f5e13-542e-45f8-a7ab-0483898e41a9', 'fedabcfa-085d-4d73-8d82-4fcf55af0332', 'fe13c675-f596-400c-a575-7c4244db47f8'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Delete snapshot completed successfully.
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cb7b3836-9a78-4de4-8ce9-ea8d4b5f2a51 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-d8636994-dc16-4673-8ddc-adb631272ae0-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:29 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8" returned: 0 in 0.248s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd2ec71-b995-4377-ab15-df7a4da594d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1ad533-f5fd-4eca-a705-cba0704b7841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:29 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Volume volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 (87c22489-ae5a-45d5-b9e5-4230a40d44c8): created successfully
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1ad533-f5fd-4eca-a705-cba0704b7841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (11c1882b-1bf0-4f65-9488-0958d6c52065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-38f87f6e-4d5b-4798-8c98-530ada1ee31d tempest-ProjectReaderTests-968238754 None] Created volume successfully.
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-40ef0ee3-80fc-49be-8547-17abaad957c4-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-40ef0ee3-80fc-49be-8547-17abaad957c4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-40ef0ee3-80fc-49be-8547-17abaad957c4" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-40ef0ee3-80fc-49be-8547-17abaad957c4" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06a4ebb-ab98-4a4f-978e-903b0a1e1392]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:29 devstack sudo[106094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4
Sep 22 15:56:29 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:30 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4" returned: 0 in 0.384s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:30 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4
Sep 22 15:56:30 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:30 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-40ef0ee3-80fc-49be-8547-17abaad957c4" returned: 0 in 0.245s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-40ef0ee3-80fc-49be-8547-17abaad957c4" released by "delete_volume" :: held 0.690s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Created reservations ['c884ba7c-83d5-4a7b-9881-4525c72f6440', '0ce26080-e7cd-4e73-8f8b-8d66e9cbdbd4', '63b8843f-1439-4a71-84aa-45bc90bf28fd', '91778157-6193-444a-9ce4-783d58761a1c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:30 devstack sudo[106103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:30 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:30 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.283s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Creating offline snapshot 2bffb40e-6fd5-4b9b-873e-21b4c4241bdc of volume 87c22489-ae5a-45d5-b9e5-4230a40d44c8 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:30 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Deleted volume successfully.
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cea61f-e63e-4b88-b90f-840a6c5ddfda]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-0ffdcf04-83c9-4ade-b31f-ef37440f39a5 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-40ef0ee3-80fc-49be-8547-17abaad957c4-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:31 devstack sudo[106106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8
Sep 22 15:56:31 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:31 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8" returned: 0 in 0.424s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:31 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc 1G
Sep 22 15:56:31 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (14171e9b-c569-446a-8fcf-21a3a7d4b6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2f3382-d370-48ec-81b6-a3144350c154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2f3382-d370-48ec-81b6-a3144350c154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450471457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1277cb8-c537-42bc-9acd-63b58eab9937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:31Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92310620-4dd1-48ce-a899-b7b24cfd2d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92310620-4dd1-48ce-a899-b7b24cfd2d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cf47fa-0f93-4500-90b8-24d834e0f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cf47fa-0f93-4500-90b8-24d834e0f214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1277cb8-c537-42bc-9acd-63b58eab9937', 'volume_name': 'volume-d1277cb8-c537-42bc-9acd-63b58eab9937', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ccfbaa-f1c9-4980-a5d3-571942d0655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ccfbaa-f1c9-4980-a5d3-571942d0655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c632e2-6cdb-47f0-8f09-a502d55cb30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:31 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Volume d1277cb8-c537-42bc-9acd-63b58eab9937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1277cb8-c537-42bc-9acd-63b58eab9937', 'volume_size': 1}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:31 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc 1G" returned: 0 in 0.407s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:31 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc
Sep 22 15:56:31 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:32 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc" returned: 0 in 0.300s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:32 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc is being set with open permissions: ugo+rw
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:32 devstack sudo[106121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc
Sep 22 15:56:32 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:32 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:32 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.info
Sep 22 15:56:32 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:32 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.info" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:32 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.info is being set with open permissions: ugo+rw
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:32 devstack sudo[106127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.info
Sep 22 15:56:32 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:32 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.info" returned: 0 in 0.243s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450471457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1277cb8-c537-42bc-9acd-63b58eab9937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:31Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Creating volume d1277cb8-c537-42bc-9acd-63b58eab9937 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:32 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:32 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937 1073741824
Sep 22 15:56:32 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3a02d53b-9de7-4614-ad89-d7c31f0d4525 tempest-ProjectReaderTests-968238754 None] Create snapshot completed successfully
Sep 22 15:56:33 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937 1073741824" returned: 0 in 0.414s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:33 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937
Sep 22 15:56:33 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:33 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937" returned: 0 in 0.258s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:33 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:33 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c632e2-6cdb-47f0-8f09-a502d55cb30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1277cb8-c537-42bc-9acd-63b58eab9937', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65013f8-abae-4b61-ade2-2d13977294d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:33 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Volume volume-d1277cb8-c537-42bc-9acd-63b58eab9937 (d1277cb8-c537-42bc-9acd-63b58eab9937): created successfully
Sep 22 15:56:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65013f8-abae-4b61-ade2-2d13977294d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:33 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (14171e9b-c569-446a-8fcf-21a3a7d4b6bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:33 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-952b4bcd-847d-4a7c-a81e-e034fd86ddbd tempest-ProjectMemberTests-1212956627 None] Created volume successfully.
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-2bffb40e-6fd5-4b9b-873e-21b4c4241bdc-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Lock "cinder-2bffb40e-6fd5-4b9b-873e-21b4c4241bdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-87c22489-ae5a-45d5-b9e5-4230a40d44c8" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-87c22489-ae5a-45d5-b9e5-4230a40d44c8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-2bffb40e-6fd5-4b9b-873e-21b4c4241bdc" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-2bffb40e-6fd5-4b9b-873e-21b4c4241bdc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Deleting offline snapshot 2bffb40e-6fd5-4b9b-873e-21b4c4241bdc of volume 87c22489-ae5a-45d5-b9e5-4230a40d44c8 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] snapshot_file for this snap is: volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[755608a8-6907-4c25-9130-ad43ca99b5ce]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:34 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc
Sep 22 15:56:34 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:34 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc" returned: 0 in 0.392s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[898c1029-098f-4b78-aab0-3df2a9225371]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:34 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8
Sep 22 15:56:34 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Creating offline snapshot 7442ed62-b603-44c8-80ab-8f4ad8b603c0 of volume d1277cb8-c537-42bc-9acd-63b58eab9937 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83d452a-95ad-414a-a365-d6be9e2ec431]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:34 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937
Sep 22 15:56:34 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:34 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8" returned: 0 in 0.404s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:35 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc
Sep 22 15:56:35 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:35 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937" returned: 0 in 0.426s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:35 devstack sudo[106160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 1G
Sep 22 15:56:35 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:35 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc" returned: 0 in 0.375s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:35 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc
Sep 22 15:56:35 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:35 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8.2bffb40e-6fd5-4b9b-873e-21b4c4241bdc" returned: 0 in 0.282s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-2bffb40e-6fd5-4b9b-873e-21b4c4241bdc" released by "_delete_snapshot" :: held 1.570s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-87c22489-ae5a-45d5-b9e5-4230a40d44c8" released by "delete_snapshot" :: held 1.602s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:35 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 1G" returned: 0 in 0.451s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1277cb8-c537-42bc-9acd-63b58eab9937 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:35 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1277cb8-c537-42bc-9acd-63b58eab9937 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0
Sep 22 15:56:35 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Created reservations ['d90e131f-0283-46ed-98e3-5a6fe7460b97', '6e305f4e-0845-440d-988f-56614465d7af', 'c5eb1107-c6ce-41c4-81f5-9b302c69d753', '806c3c26-f77c-48aa-8661-499767d928d8'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Delete snapshot completed successfully.
Sep 22 15:56:35 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-229cba11-1097-4b47-9bea-ecc4dd2f30fc tempest-ProjectReaderTests-968238754 None] Lock "cinder-2bffb40e-6fd5-4b9b-873e-21b4c4241bdc-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:36 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1277cb8-c537-42bc-9acd-63b58eab9937 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0" returned: 0 in 0.309s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:36 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 is being set with open permissions: ugo+rw
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:36 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0
Sep 22 15:56:36 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-87c22489-ae5a-45d5-b9e5-4230a40d44c8-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Lock "cinder-87c22489-ae5a-45d5-b9e5-4230a40d44c8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:36 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-87c22489-ae5a-45d5-b9e5-4230a40d44c8" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-87c22489-ae5a-45d5-b9e5-4230a40d44c8" acquired by "delete_volume" :: waited 0.033s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:36 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.info
Sep 22 15:56:36 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[603916d1-b547-494a-8689-5b4b474de49f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:36 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8
Sep 22 15:56:36 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:36 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.info" returned: 0 in 0.260s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:36 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.info is being set with open permissions: ugo+rw
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:36 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.info
Sep 22 15:56:36 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:36 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8" returned: 0 in 0.379s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:36 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8
Sep 22 15:56:36 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:36 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.info" returned: 0 in 0.256s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:36 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-0fdbd480-8034-4f68-b72f-434d316a5675 tempest-ProjectMemberTests-1212956627 None] Create snapshot completed successfully
Sep 22 15:56:37 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-87c22489-ae5a-45d5-b9e5-4230a40d44c8" returned: 0 in 0.267s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-87c22489-ae5a-45d5-b9e5-4230a40d44c8" released by "delete_volume" :: held 0.716s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Created reservations ['d6d31f77-c36a-4eec-bb97-ad219fac2e52', '37695e94-de5b-4317-b773-30a99cd248b8', 'ea4d8f60-0c88-4884-a583-b0647a320948', '796d160b-bae0-4d9c-96b6-2ed86d19a452'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:37 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:37 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:37 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.247s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:37 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Deleted volume successfully.
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-04e91331-73b8-42f4-bbfb-115ed89c0dbe tempest-ProjectReaderTests-968238754 None] Lock "cinder-87c22489-ae5a-45d5-b9e5-4230a40d44c8-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (4f8c6818-d5a2-4422-9fe4-bcb498f146a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de85bcc0-ff61-4b6d-9b73-d4fcf2ed392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de85bcc0-ff61-4b6d-9b73-d4fcf2ed392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-114992924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423f49dd-1a63-4af9-88d8-10e72ccd5ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:38Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb926c94-e211-46f8-ab4c-d4b56ad86e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb926c94-e211-46f8-ab4c-d4b56ad86e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b58201d-fea2-4e52-b2f4-4cd549717676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b58201d-fea2-4e52-b2f4-4cd549717676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423f49dd-1a63-4af9-88d8-10e72ccd5ca5', 'volume_name': 'volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed1ccbc-9d41-497f-97b3-769a93b0ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed1ccbc-9d41-497f-97b3-769a93b0ae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e14935-8672-4049-83b6-a812120a5f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:37 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Volume 423f49dd-1a63-4af9-88d8-10e72ccd5ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5', 'volume_size': 1}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-114992924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423f49dd-1a63-4af9-88d8-10e72ccd5ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:38Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Creating volume 423f49dd-1a63-4af9-88d8-10e72ccd5ca5 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:37 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-7442ed62-b603-44c8-80ab-8f4ad8b603c0-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:37 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 1073741824
Sep 22 15:56:37 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Lock "cinder-7442ed62-b603-44c8-80ab-8f4ad8b603c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-d1277cb8-c537-42bc-9acd-63b58eab9937" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d1277cb8-c537-42bc-9acd-63b58eab9937" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-7442ed62-b603-44c8-80ab-8f4ad8b603c0" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-7442ed62-b603-44c8-80ab-8f4ad8b603c0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Deleting offline snapshot 7442ed62-b603-44c8-80ab-8f4ad8b603c0 of volume d1277cb8-c537-42bc-9acd-63b58eab9937 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] snapshot_file for this snap is: volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12198ea-007f-434a-b6c6-0439fdcb77d9]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:38 devstack sudo[106199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0
Sep 22 15:56:38 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:38 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 1073741824" returned: 0 in 0.461s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:38 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0" returned: 0 in 0.411s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1277cb8-c537-42bc-9acd-63b58eab9937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:38 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5
Sep 22 15:56:38 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab69c8-60cc-4422-a70c-c14dea3c94e5]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:38 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937
Sep 22 15:56:38 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:38 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" returned: 0 in 0.261s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e14935-8672-4049-83b6-a812120a5f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09c6d7c-abd1-4f14-8fdb-f0caeff915f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Volume volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 (423f49dd-1a63-4af9-88d8-10e72ccd5ca5): created successfully
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09c6d7c-abd1-4f14-8fdb-f0caeff915f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (4f8c6818-d5a2-4422-9fe4-bcb498f146a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ae662b9c-732d-4c29-a781-286c510f5466 tempest-ProjectReaderTests-968238754 None] Created volume successfully.
Sep 22 15:56:38 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937" returned: 0 in 0.398s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:38 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0
Sep 22 15:56:38 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Creating offline snapshot fc7552be-eab6-4600-b64d-e9efc43e468c of volume 423f49dd-1a63-4af9-88d8-10e72ccd5ca5 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8c354b-b615-4850-bba0-84c70be84c7f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:39 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5
Sep 22 15:56:39 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:39 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0" returned: 0 in 0.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:39 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0
Sep 22 15:56:39 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:39 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" returned: 0 in 0.384s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:39 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c 1G
Sep 22 15:56:39 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:39 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937.7442ed62-b603-44c8-80ab-8f4ad8b603c0" returned: 0 in 0.273s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-7442ed62-b603-44c8-80ab-8f4ad8b603c0" released by "_delete_snapshot" :: held 1.569s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d1277cb8-c537-42bc-9acd-63b58eab9937" released by "delete_snapshot" :: held 1.595s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Created reservations ['999b177a-a947-4c4e-9e87-1018186ccfd1', '4510679e-b3ba-40b2-9cd8-63b91498d9bb', 'fa62a708-9325-4926-b664-2c462750cf65', 'b9d341e6-a37d-43a3-be68-d4115436c753'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:39 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Delete snapshot completed successfully.
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-17490074-e761-4e1e-bee2-af0a9c90d4af tempest-ProjectMemberTests-1212956627 None] Lock "cinder-7442ed62-b603-44c8-80ab-8f4ad8b603c0-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:39 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c 1G" returned: 0 in 0.409s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:39 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c
Sep 22 15:56:39 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-d1277cb8-c537-42bc-9acd-63b58eab9937-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-d1277cb8-c537-42bc-9acd-63b58eab9937-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-d1277cb8-c537-42bc-9acd-63b58eab9937" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d1277cb8-c537-42bc-9acd-63b58eab9937" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:40 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c" returned: 0 in 0.337s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:40 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c is being set with open permissions: ugo+rw
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[90139485-d01b-4d92-a525-9365a33ef075]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:40 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c
Sep 22 15:56:40 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:40 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937
Sep 22 15:56:40 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:40 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c" returned: 0 in 0.239s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:40 devstack sudo[106243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.info
Sep 22 15:56:40 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:40 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937" returned: 0 in 0.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:40 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937
Sep 22 15:56:40 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:40 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.info" returned: 0 in 0.267s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:40 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.info is being set with open permissions: ugo+rw
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:40 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.info
Sep 22 15:56:40 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:40 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d1277cb8-c537-42bc-9acd-63b58eab9937" returned: 0 in 0.259s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d1277cb8-c537-42bc-9acd-63b58eab9937" released by "delete_volume" :: held 0.716s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:40 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Created reservations ['33274233-b407-4a4c-9802-14b60373fc53', 'c40a2fc0-48c4-4249-82dc-69738db045c1', '3a1fda8a-a328-4936-b5ba-e43c2c0c949e', '9d101f75-59cf-45a7-8e1d-b5bee4031558'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:41 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.info" returned: 0 in 0.266s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:41 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:41 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:41 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-08b5d328-b8ec-457b-936f-eaee7c3e5e78 tempest-ProjectReaderTests-968238754 None] Create snapshot completed successfully
Sep 22 15:56:41 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.269s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:41 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Deleted volume successfully.
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-85145ce1-b3a6-4b5a-8a46-f920c3fe7a09 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-d1277cb8-c537-42bc-9acd-63b58eab9937-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (d14161c0-05c9-458a-908c-61ba997698ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356148c0-bcf5-4e33-9c3c-649a97dc99e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356148c0-bcf5-4e33-9c3c-649a97dc99e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682818546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dadb073-3156-4287-951a-d7328586c68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:42Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b011367b-124f-49b2-82db-7353540c8947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b011367b-124f-49b2-82db-7353540c8947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de8a4a2-c9af-4b22-a896-163b2c1392ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de8a4a2-c9af-4b22-a896-163b2c1392ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dadb073-3156-4287-951a-d7328586c68e', 'volume_name': 'volume-6dadb073-3156-4287-951a-d7328586c68e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dbfe9c-08c4-436c-b14a-850ce46abdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dbfe9c-08c4-436c-b14a-850ce46abdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96437e64-e9df-486c-b3cd-0cd6c9259e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:41 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Volume 6dadb073-3156-4287-951a-d7328586c68e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dadb073-3156-4287-951a-d7328586c68e', 'volume_size': 1}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682818546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dadb073-3156-4287-951a-d7328586c68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:42Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Creating volume 6dadb073-3156-4287-951a-d7328586c68e {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:41 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:41 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:41 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e 1073741824
Sep 22 15:56:41 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:42 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e 1073741824" returned: 0 in 0.478s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-fc7552be-eab6-4600-b64d-e9efc43e468c-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Lock "cinder-fc7552be-eab6-4600-b64d-e9efc43e468c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-fc7552be-eab6-4600-b64d-e9efc43e468c" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-fc7552be-eab6-4600-b64d-e9efc43e468c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Deleting offline snapshot fc7552be-eab6-4600-b64d-e9efc43e468c of volume 423f49dd-1a63-4af9-88d8-10e72ccd5ca5 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:42 devstack sudo[106265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e
Sep 22 15:56:42 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] snapshot_file for this snap is: volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa603355-5040-4087-8838-17ccfc81270a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:42 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c
Sep 22 15:56:42 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:42 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96437e64-e9df-486c-b3cd-0cd6c9259e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dadb073-3156-4287-951a-d7328586c68e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b261a1-e98c-49bf-a426-a0504392673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:42 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Volume volume-6dadb073-3156-4287-951a-d7328586c68e (6dadb073-3156-4287-951a-d7328586c68e): created successfully
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b261a1-e98c-49bf-a426-a0504392673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (d14161c0-05c9-458a-908c-61ba997698ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:42 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-1ea6454d-de02-49ec-b1a4-3af014ef862c tempest-ProjectMemberTests-1212956627 None] Created volume successfully.
Sep 22 15:56:42 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c" returned: 0 in 0.380s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7825738d-452d-48a1-a2e0-74ebcb8f9210]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:42 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:42 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5
Sep 22 15:56:42 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:43 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" returned: 0 in 0.357s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:43 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c
Sep 22 15:56:43 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:43 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c" returned: 0 in 0.315s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:43 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c
Sep 22 15:56:43 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:43 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5.fc7552be-eab6-4600-b64d-e9efc43e468c" returned: 0 in 0.247s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-fc7552be-eab6-4600-b64d-e9efc43e468c" released by "_delete_snapshot" :: held 1.403s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" released by "delete_snapshot" :: held 1.437s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Created reservations ['3d857beb-be97-4d95-96b2-787d8e7ac12a', '1c54ae7a-e3b9-47e4-832b-d319f9ae4569', '23022ebe-889b-4aaa-8acb-07ed375daf3a', '8a54e36c-0302-46ae-b150-c31370b7d018'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:43 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Delete snapshot completed successfully.
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-f796d34c-8cdb-484c-b668-b49023b5fc9d tempest-ProjectReaderTests-968238754 None] Lock "cinder-fc7552be-eab6-4600-b64d-e9efc43e468c-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:43 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Creating offline snapshot afde9c5b-a510-43d4-aec8-44e91b5efac8 of volume 6dadb073-3156-4287-951a-d7328586c68e {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a84ef6-8c19-4f8e-956c-4ad05da4ef8c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:44 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e
Sep 22 15:56:44 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:44 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e" returned: 0 in 0.402s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:44 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 1G
Sep 22 15:56:44 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-423f49dd-1a63-4af9-88d8-10e72ccd5ca5-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Lock "cinder-423f49dd-1a63-4af9-88d8-10e72ccd5ca5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1fa675-c228-4839-9e43-f455a5f83b7d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:44 devstack sudo[106295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5
Sep 22 15:56:44 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:44 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 1G" returned: 0 in 0.426s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dadb073-3156-4287-951a-d7328586c68e -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:44 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dadb073-3156-4287-951a-d7328586c68e -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8
Sep 22 15:56:44 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:44 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" returned: 0 in 0.393s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:44 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:45 devstack sudo[106305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5
Sep 22 15:56:45 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:45 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dadb073-3156-4287-951a-d7328586c68e -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8" returned: 0 in 0.308s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:45 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 is being set with open permissions: ugo+rw
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:45 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8
Sep 22 15:56:45 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:45 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-423f49dd-1a63-4af9-88d8-10e72ccd5ca5" released by "delete_volume" :: held 0.729s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Created reservations ['6daf3daf-dfe1-4fc7-be87-350f3add7f85', '2766cc5b-5176-406c-b81a-2c0faca5584a', '43b0260c-9b97-4f15-bfbf-44088fc7a692', 'b2652672-687f-4e6a-9048-b9036abdbdb0'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:45 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:45 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:45 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8" returned: 0 in 0.264s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:45 devstack sudo[106316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.info
Sep 22 15:56:45 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:45 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.268s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:45 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Deleted volume successfully.
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-50cec064-babc-4217-99b4-4e8feec63d88 tempest-ProjectReaderTests-968238754 None] Lock "cinder-423f49dd-1a63-4af9-88d8-10e72ccd5ca5-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:45 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.info" returned: 0 in 0.290s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:45 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.info is being set with open permissions: ugo+rw
Sep 22 15:56:45 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:45 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.info
Sep 22 15:56:45 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:46 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.info" returned: 0 in 0.258s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-448b4c70-6ea3-456b-b5c5-0eb117827946 tempest-ProjectMemberTests-1212956627 None] Create snapshot completed successfully
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (c309ca93-33e9-4490-94a9-2b0fc4c2ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8096e397-553d-447a-9901-39e3d8b77b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8096e397-553d-447a-9901-39e3d8b77b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139754540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:46Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9868368e-807a-4cb0-9505-3aa8435601c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9868368e-807a-4cb0-9505-3aa8435601c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66aca04-84c3-4277-9f7e-2a996577f37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66aca04-84c3-4277-9f7e-2a996577f37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef', 'volume_name': 'volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a79c858-7c2c-4f8e-a72e-2ddb9a58fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a79c858-7c2c-4f8e-a72e-2ddb9a58fa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a3adfa-5ef4-4004-a79b-e171bef0fdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:46 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Volume 1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef', 'volume_size': 1}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139754540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87161b7db3e40179c28ab90e05abe3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:46Z,use_quota=True,user_id='c33c121f2e7b4dda8c5c0a0dfaad872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Creating volume 1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:46 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:46 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef 1073741824
Sep 22 15:56:46 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:46 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef 1073741824" returned: 0 in 0.399s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:46 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef
Sep 22 15:56:46 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:46 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" returned: 0 in 0.240s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a3adfa-5ef4-4004-a79b-e171bef0fdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ae7f67-fdc1-4b7e-9e3d-66a540f66614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:46 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Volume volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef (1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef): created successfully
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ae7f67-fdc1-4b7e-9e3d-66a540f66614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:46 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Flow 'volume_create_manager' (c309ca93-33e9-4490-94a9-2b0fc4c2ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:46 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f117fdd5-f057-4be5-a866-7e294caea323 tempest-ProjectReaderTests-968238754 None] Created volume successfully.
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-afde9c5b-a510-43d4-aec8-44e91b5efac8-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Lock "cinder-afde9c5b-a510-43d4-aec8-44e91b5efac8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-6dadb073-3156-4287-951a-d7328586c68e" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-6dadb073-3156-4287-951a-d7328586c68e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-afde9c5b-a510-43d4-aec8-44e91b5efac8" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-afde9c5b-a510-43d4-aec8-44e91b5efac8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Deleting offline snapshot afde9c5b-a510-43d4-aec8-44e91b5efac8 of volume 6dadb073-3156-4287-951a-d7328586c68e {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] snapshot_file for this snap is: volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c0dbfb-2e03-4b6f-b4e3-3717f43d17f2]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Creating offline snapshot 4624c807-70f8-415c-a9d9-c98e7ec75ccb of volume 1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf71a7eb-df8b-4673-9eea-7bc11e4162e2]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:47 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8
Sep 22 15:56:47 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:47 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef
Sep 22 15:56:47 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:47 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8" returned: 0 in 0.408s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dadb073-3156-4287-951a-d7328586c68e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a0ff1-3741-4e8e-b8e3-e2ae3328db0c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:47 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" returned: 0 in 0.397s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:47 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:47 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb 1G
Sep 22 15:56:47 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:47 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e
Sep 22 15:56:47 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:48 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e" returned: 0 in 0.404s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:48 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb 1G" returned: 0 in 0.413s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:48 devstack sudo[106354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8
Sep 22 15:56:48 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:48 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb
Sep 22 15:56:48 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:48 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb" returned: 0 in 0.303s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:48 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb is being set with open permissions: ugo+rw
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:48 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb
Sep 22 15:56:48 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:48 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8" returned: 0 in 0.380s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:48 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8
Sep 22 15:56:48 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:48 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:48 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.info
Sep 22 15:56:48 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:48 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e.afde9c5b-a510-43d4-aec8-44e91b5efac8" returned: 0 in 0.278s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-afde9c5b-a510-43d4-aec8-44e91b5efac8" released by "_delete_snapshot" :: held 1.599s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-6dadb073-3156-4287-951a-d7328586c68e" released by "delete_snapshot" :: held 1.623s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Created reservations ['10a2789c-b899-4664-a022-8ef4da43c326', 'e915e433-a372-485e-90a6-68aa0cf223e1', 'b861cea1-e042-4a48-af17-6589c8c2403f', '232a2cda-0125-4aa8-81cc-2314f31c9ed5'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:48 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Delete snapshot completed successfully.
Sep 22 15:56:48 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-328f15b3-984b-4da7-b3b1-ca0284ce4def tempest-ProjectMemberTests-1212956627 None] Lock "cinder-afde9c5b-a510-43d4-aec8-44e91b5efac8-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:49 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.info" returned: 0 in 0.285s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:49 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.info is being set with open permissions: ugo+rw
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:49 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.info
Sep 22 15:56:49 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:49 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.info" returned: 0 in 0.277s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-6dadb073-3156-4287-951a-d7328586c68e-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-6dadb073-3156-4287-951a-d7328586c68e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:49 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-b7dd1663-478a-47a5-85d8-cdbf6def87a7 tempest-ProjectReaderTests-968238754 None] Create snapshot completed successfully
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-6dadb073-3156-4287-951a-d7328586c68e" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-6dadb073-3156-4287-951a-d7328586c68e" acquired by "delete_volume" :: waited 0.014s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60fa348-fcff-4737-ac9b-53c343382711]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:49 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e
Sep 22 15:56:49 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:49 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e" returned: 0 in 0.347s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:49 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:49 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e
Sep 22 15:56:49 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:50 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-6dadb073-3156-4287-951a-d7328586c68e" returned: 0 in 0.254s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-6dadb073-3156-4287-951a-d7328586c68e" released by "delete_volume" :: held 0.667s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Created reservations ['7f609c1e-9e93-4976-bd8e-ce3c82543e88', '9208b4cb-ab3e-4d9b-b176-8df7c1c9cf95', '0d40040f-b800-44eb-8725-e88e5ea9c858', '652806ae-53e2-4fc8-9e11-99cb2b19e5bf'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:50 devstack sudo[106385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:50 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-4624c807-70f8-415c-a9d9-c98e7ec75ccb-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Lock "cinder-4624c807-70f8-415c-a9d9-c98e7ec75ccb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-4624c807-70f8-415c-a9d9-c98e7ec75ccb" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-4624c807-70f8-415c-a9d9-c98e7ec75ccb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Deleting offline snapshot 4624c807-70f8-415c-a9d9-c98e7ec75ccb of volume 1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] snapshot_file for this snap is: volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:50 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8966058b-eb66-48e6-bec4-5fb6afe73444]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.299s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:50 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Deleted volume successfully.
Sep 22 15:56:50 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3b75c07b-8b4e-41f8-ab19-40ef60bc5510 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-6dadb073-3156-4287-951a-d7328586c68e-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:50 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb
Sep 22 15:56:50 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:51 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb" returned: 0 in 0.426s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ec2306-3cda-4602-9694-42a1aeefd74e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (304d204d-4d1a-493c-8827-6b3e8aba0690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4ef0b0-8eaf-436f-a63c-5b42db778ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4ef0b0-8eaf-436f-a63c-5b42db778ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29941416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c687b2-cbaa-4552-8392-c84fb16a5394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:51Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98945dbe-247f-4147-aa92-cf955f9f09a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98945dbe-247f-4147-aa92-cf955f9f09a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24a0a56-7799-4bed-9c93-50588389d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24a0a56-7799-4bed-9c93-50588389d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c687b2-cbaa-4552-8392-c84fb16a5394', 'volume_name': 'volume-50c687b2-cbaa-4552-8392-c84fb16a5394', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:51 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8375b2ce-f93d-4254-81ae-5fb1095a5cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:51 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8375b2ce-f93d-4254-81ae-5fb1095a5cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ecc42c-dc20-4117-9dd4-ef20d80ae0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:51 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Volume 50c687b2-cbaa-4552-8392-c84fb16a5394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c687b2-cbaa-4552-8392-c84fb16a5394', 'volume_size': 1}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29941416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c687b2-cbaa-4552-8392-c84fb16a5394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:56:51Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Creating volume 50c687b2-cbaa-4552-8392-c84fb16a5394 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:56:51 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:51 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394 1073741824
Sep 22 15:56:51 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:51 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" returned: 0 in 0.405s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:51 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb
Sep 22 15:56:51 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:51 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394 1073741824" returned: 0 in 0.537s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:51 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394
Sep 22 15:56:51 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:51 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb" returned: 0 in 0.412s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:51 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:51 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb
Sep 22 15:56:51 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:52 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394" returned: 0 in 0.280s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ecc42c-dc20-4117-9dd4-ef20d80ae0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c687b2-cbaa-4552-8392-c84fb16a5394', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e651a4b5-b6b8-4ffe-934d-0332c1181c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:56:52 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Volume volume-50c687b2-cbaa-4552-8392-c84fb16a5394 (50c687b2-cbaa-4552-8392-c84fb16a5394): created successfully
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e651a4b5-b6b8-4ffe-934d-0332c1181c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (304d204d-4d1a-493c-8827-6b3e8aba0690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:56:52 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-f5860755-9c1d-4f66-9660-3f2b010b9546 tempest-ProjectMemberTests-1212956627 None] Created volume successfully.
Sep 22 15:56:52 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef.4624c807-70f8-415c-a9d9-c98e7ec75ccb" returned: 0 in 0.260s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-4624c807-70f8-415c-a9d9-c98e7ec75ccb" released by "_delete_snapshot" :: held 1.629s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" released by "delete_snapshot" :: held 1.656s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Created reservations ['1702f6b0-f6a6-48aa-9454-bbe61b6b6b93', '6c76043a-350d-43eb-8d69-33b01e77ffb1', '86dcc0a9-d834-4399-937f-bdc887833a9d', '0779cec7-dc63-4337-a663-cd02b69dc06c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:52 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Delete snapshot completed successfully.
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-d49ccb16-271c-45fc-add3-913365f55965 tempest-ProjectReaderTests-968238754 None] Lock "cinder-4624c807-70f8-415c-a9d9-c98e7ec75ccb-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Lock "cinder-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Acquiring lock "cinder-quobyte-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" acquired by "delete_volume" :: waited 0.013s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cdd819-00f0-4c05-aaa5-50939586072a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:52 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:52 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef
Sep 22 15:56:52 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:53 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" returned: 0 in 0.372s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:53 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef
Sep 22 15:56:53 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Creating offline snapshot 3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 of volume 50c687b2-cbaa-4552-8392-c84fb16a5394 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cae359-0132-424d-92c0-9267602fc4b3]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:53 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" returned: 0 in 0.271s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Lock "cinder-quobyte-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef" released by "delete_volume" :: held 0.704s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Created reservations ['a1feb812-bc87-48b8-a73d-32ba1174d25d', '982a9eae-6483-4337-b5b8-1a93c1d7bcbc', 'c1de3383-630c-4529-b3ce-233fd979d85e', 'e0fb1e13-a3a1-4671-bb97-120c157d9cfd'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:53 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394
Sep 22 15:56:53 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:53 devstack sudo[106426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:53 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:53 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394" returned: 0 in 0.415s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:53 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.265s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:53 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 1G
Sep 22 15:56:53 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:53 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Deleted volume successfully.
Sep 22 15:56:53 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-08ae911c-f1f1-48bb-8bd0-521b41a8d1ee tempest-ProjectReaderTests-968238754 None] Lock "cinder-1e934edd-e34f-4ef3-bc4e-bdd0de06a7ef-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:54 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 1G" returned: 0 in 0.463s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50c687b2-cbaa-4552-8392-c84fb16a5394 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:54 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50c687b2-cbaa-4552-8392-c84fb16a5394 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0
Sep 22 15:56:54 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:54 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50c687b2-cbaa-4552-8392-c84fb16a5394 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0" returned: 0 in 0.296s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:54 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 is being set with open permissions: ugo+rw
Sep 22 15:56:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:54 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0
Sep 22 15:56:54 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:54 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0" returned: 0 in 0.303s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:54 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:54 devstack sudo[106446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.info
Sep 22 15:56:54 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:55 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.info" returned: 0 in 0.294s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:55 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.info is being set with open permissions: ugo+rw
Sep 22 15:56:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:55 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.info
Sep 22 15:56:55 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:55 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.info" returned: 0 in 0.267s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:55 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:55 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c7ff47c1-ba1d-4bf5-90f6-948850a14727 tempest-ProjectMemberTests-1212956627 None] Create snapshot completed successfully
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-50c687b2-cbaa-4552-8392-c84fb16a5394" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-50c687b2-cbaa-4552-8392-c84fb16a5394" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Deleting offline snapshot 3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 of volume 50c687b2-cbaa-4552-8392-c84fb16a5394 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] snapshot_file for this snap is: volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[985c6324-8668-4f07-b252-8bd6a50b48eb]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:56 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0
Sep 22 15:56:56 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:57 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0" returned: 0 in 0.402s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50c687b2-cbaa-4552-8392-c84fb16a5394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:56:57 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37fe146-552b-4722-a19c-cfc68c7aba1c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:57 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394
Sep 22 15:56:57 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:57 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394" returned: 0 in 0.425s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:57 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0
Sep 22 15:56:57 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:57 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0" returned: 0 in 0.364s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:57 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0
Sep 22 15:56:57 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:58 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394.3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0" returned: 0 in 0.248s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0" released by "_delete_snapshot" :: held 1.551s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-50c687b2-cbaa-4552-8392-c84fb16a5394" released by "delete_snapshot" :: held 1.586s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Created reservations ['3e2ecda5-2685-4a0b-b29e-f6a2f3ce381a', '066d2718-8b15-452e-80a6-3ceb18a64f48', '791c4880-d5cc-4117-b455-49d0cd288ed6', '5c41a79e-5cb3-42d0-a037-6d03bc346b23'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Delete snapshot completed successfully.
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-173ed20f-2e77-46cf-9c4c-9c750500ef77 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-3ee2a197-09c9-4a6c-92e3-2e3b9b7622b0-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-50c687b2-cbaa-4552-8392-c84fb16a5394-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-50c687b2-cbaa-4552-8392-c84fb16a5394-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-50c687b2-cbaa-4552-8392-c84fb16a5394" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-50c687b2-cbaa-4552-8392-c84fb16a5394" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db6a735-af3e-4823-8fde-ac8d0dc93e3f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:56:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:58 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394
Sep 22 15:56:58 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:59 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394" returned: 0 in 0.386s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:59 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394
Sep 22 15:56:59 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:59 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-50c687b2-cbaa-4552-8392-c84fb16a5394" returned: 0 in 0.258s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-50c687b2-cbaa-4552-8392-c84fb16a5394" released by "delete_volume" :: held 0.717s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Created reservations ['e6161658-578c-43e8-9fd6-400f22c628a6', '53188393-0067-4b3f-adf5-efcb798548b0', '3fdf8380-3c4b-4cc1-9004-e80c68fae72f', 'ae7b1890-5524-4900-a25c-16ca40714283'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:56:59 devstack sudo[106479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:56:59 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:56:59 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.275s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:56:59 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Deleted volume successfully.
Sep 22 15:56:59 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-8198fa29-8e9e-47c9-a560-d1244b2f9276 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-50c687b2-cbaa-4552-8392-c84fb16a5394-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (e924cb34-3147-4e9e-911f-f34a05510f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b65c48b-0343-4e4f-ad81-83f561ec249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b65c48b-0343-4e4f-ad81-83f561ec249c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614459417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c796d2-871c-40bd-aefe-e0f78601ba27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:00Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eeaf6c-0e15-4ebd-b8dd-bf6b5bbac11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eeaf6c-0e15-4ebd-b8dd-bf6b5bbac11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a6202d-09b9-4ada-a30e-3cef5b3e4c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a6202d-09b9-4ada-a30e-3cef5b3e4c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c796d2-871c-40bd-aefe-e0f78601ba27', 'volume_name': 'volume-d3c796d2-871c-40bd-aefe-e0f78601ba27', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09df4a6a-4d3f-45da-950e-f877b3cda82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09df4a6a-4d3f-45da-950e-f877b3cda82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6277f9c-f7eb-4680-9814-58a43d8ce76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:00 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Volume d3c796d2-871c-40bd-aefe-e0f78601ba27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c796d2-871c-40bd-aefe-e0f78601ba27', 'volume_size': 1}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614459417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c796d2-871c-40bd-aefe-e0f78601ba27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:00Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Creating volume d3c796d2-871c-40bd-aefe-e0f78601ba27 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:57:00 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:57:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:00 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 1073741824
Sep 22 15:57:00 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:01 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 1073741824" returned: 0 in 0.573s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:01 devstack sudo[106489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27
Sep 22 15:57:01 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:01 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27" returned: 0 in 0.292s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:57:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6277f9c-f7eb-4680-9814-58a43d8ce76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c796d2-871c-40bd-aefe-e0f78601ba27', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56e4a9f-ea03-416f-b4eb-7b52d91f0d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:01 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Volume volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 (d3c796d2-871c-40bd-aefe-e0f78601ba27): created successfully
Sep 22 15:57:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56e4a9f-ea03-416f-b4eb-7b52d91f0d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:01 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (e924cb34-3147-4e9e-911f-f34a05510f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:01 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bc5432c4-af2d-4ab5-86a7-568fe8381c61 tempest-ProjectMemberTests-1212956627 None] Created volume successfully.
Sep 22 15:57:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Creating offline snapshot ae18f7b1-60ae-4285-914d-a75c2507ba97 of volume d3c796d2-871c-40bd-aefe-e0f78601ba27 {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:57:02 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29bdb59-f270-4307-8d96-973a84caa2f8]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:02 devstack sudo[106492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27
Sep 22 15:57:02 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:03 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27" returned: 0 in 0.401s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:03 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 1G
Sep 22 15:57:03 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:03 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 1G" returned: 0 in 0.420s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:03 devstack sudo[106503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97
Sep 22 15:57:03 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:03 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97" returned: 0 in 0.309s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:03 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 is being set with open permissions: ugo+rw
Sep 22 15:57:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:03 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97
Sep 22 15:57:03 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:04 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97" returned: 0 in 0.253s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:04 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.info
Sep 22 15:57:04 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:04 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.info" returned: 0 in 0.304s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:04 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.info is being set with open permissions: ugo+rw
Sep 22 15:57:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:04 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.info
Sep 22 15:57:04 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:04 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.info" returned: 0 in 0.279s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:04 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-059b841f-0d68-4b4e-a07a-e7f0edc0e74f tempest-ProjectMemberTests-1212956627 None] Create snapshot completed successfully
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-ae18f7b1-60ae-4285-914d-a75c2507ba97-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-ae18f7b1-60ae-4285-914d-a75c2507ba97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-d3c796d2-871c-40bd-aefe-e0f78601ba27" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d3c796d2-871c-40bd-aefe-e0f78601ba27" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-ae18f7b1-60ae-4285-914d-a75c2507ba97" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-ae18f7b1-60ae-4285-914d-a75c2507ba97" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Deleting offline snapshot ae18f7b1-60ae-4285-914d-a75c2507ba97 of volume d3c796d2-871c-40bd-aefe-e0f78601ba27 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] snapshot_file for this snap is: volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[40175113-690e-4376-aeb1-a08bcc831f9b]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:06 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97
Sep 22 15:57:06 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:06 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97" returned: 0 in 0.454s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3c796d2-871c-40bd-aefe-e0f78601ba27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:57:06 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d266c9-1d56-4566-8ab2-b35c1a877e45]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:06 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27
Sep 22 15:57:06 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:06 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27" returned: 0 in 0.370s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:06 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97
Sep 22 15:57:06 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:07 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97" returned: 0 in 0.376s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:07 devstack sudo[106533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97
Sep 22 15:57:07 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:07 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:07 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27.ae18f7b1-60ae-4285-914d-a75c2507ba97" returned: 0 in 0.274s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-ae18f7b1-60ae-4285-914d-a75c2507ba97" released by "_delete_snapshot" :: held 1.582s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d3c796d2-871c-40bd-aefe-e0f78601ba27" released by "delete_snapshot" :: held 1.605s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:07 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Created reservations ['418b7a60-8131-4e0c-86d5-829e25e4db92', '010280ab-158e-4ce8-943d-7934abe2cddf', 'a62548d5-0acb-432f-a4c4-8bad53735a05', 'd403b7c2-5d5d-4378-827d-cb8b606cc766'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:07 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Delete snapshot completed successfully.
Sep 22 15:57:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-10db3cf0-16f3-480f-9f57-e3dda52bcb80 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-ae18f7b1-60ae-4285-914d-a75c2507ba97-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:07 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-d3c796d2-871c-40bd-aefe-e0f78601ba27-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-d3c796d2-871c-40bd-aefe-e0f78601ba27-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-d3c796d2-871c-40bd-aefe-e0f78601ba27" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d3c796d2-871c-40bd-aefe-e0f78601ba27" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c92a00-ee1a-41fe-89a3-f3fca064c621]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:08 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27
Sep 22 15:57:08 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:08 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27" returned: 0 in 0.423s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:08 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27
Sep 22 15:57:08 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:08 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-d3c796d2-871c-40bd-aefe-e0f78601ba27" returned: 0 in 0.246s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-d3c796d2-871c-40bd-aefe-e0f78601ba27" released by "delete_volume" :: held 0.747s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Created reservations ['d8bab3b0-b372-4fe4-929f-71b8261970dd', '41c788ab-1273-4272-b578-ed729f0fb080', 'c9c638a3-711e-47a9-a92b-25de155ce678', 'b4df3844-a5f8-4445-86fc-d2a775819536'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:08 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:08 devstack sudo[106544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:57:08 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:09 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.287s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:57:09 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Deleted volume successfully.
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-574b6f66-da14-45c6-b5de-f2e406b1d691 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-d3c796d2-871c-40bd-aefe-e0f78601ba27-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (a4ccf1d3-b7ae-4d35-ba38-23542692d7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2753fe-10fa-4f5c-97db-e9d5f27d2396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2753fe-10fa-4f5c-97db-e9d5f27d2396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027378272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c880a9-789f-4d72-8f58-6dcdbf500b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:10Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d074b4d7-f0cf-4eb5-9c12-0b98010dd210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d074b4d7-f0cf-4eb5-9c12-0b98010dd210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dce4d3-f7a5-496d-8afa-4666706b4fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dce4d3-f7a5-496d-8afa-4666706b4fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c880a9-789f-4d72-8f58-6dcdbf500b2a', 'volume_name': 'volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c238cfd7-1365-4956-b9d0-58d70b0c993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c238cfd7-1365-4956-b9d0-58d70b0c993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ee5bed-b631-4805-9806-06be875d2f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:09 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Volume f4c880a9-789f-4d72-8f58-6dcdbf500b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a', 'volume_size': 1}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027378272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c880a9-789f-4d72-8f58-6dcdbf500b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a0fcc6fe804464bc4222858f927a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:10Z,use_quota=True,user_id='661983e41f7440fa99c0a3c21a050b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Creating volume f4c880a9-789f-4d72-8f58-6dcdbf500b2a {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:57:09 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:57:09 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:09 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a 1073741824
Sep 22 15:57:09 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:10 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a 1073741824" returned: 0 in 0.508s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=173,cinder:UPDATE=227,cinder:INSERT=63,cinder:DELETE=19 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:DELETE=18,cinder:SELECT=176,cinder:UPDATE=221,cinder:INSERT=61 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:10 devstack sudo[106554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a
Sep 22 15:57:10 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:10 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" returned: 0 in 0.299s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ee5bed-b631-4805-9806-06be875d2f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b93ecd-c69f-4785-8a8e-e193228fab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:10 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Volume volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a (f4c880a9-789f-4d72-8f58-6dcdbf500b2a): created successfully
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b93ecd-c69f-4785-8a8e-e193228fab89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:10 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Flow 'volume_create_manager' (a4ccf1d3-b7ae-4d35-ba38-23542692d7a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:10 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-6a70f99f-7f1b-4054-9208-f502c16622bb tempest-ProjectMemberTests-1212956627 None] Created volume successfully.
Sep 22 15:57:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:12 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Creating offline snapshot 5a1e3475-3f46-4a1a-b4d9-19fc734ca449 of volume f4c880a9-789f-4d72-8f58-6dcdbf500b2a {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:57:12 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b3f45-ee79-4260-8345-90384d4f9b8f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:12 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a
Sep 22 15:57:12 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:12 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" returned: 0 in 0.419s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:12 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:12 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 1G
Sep 22 15:57:12 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:13 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 1G" returned: 0 in 0.479s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:13 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449
Sep 22 15:57:13 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:13 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449" returned: 0 in 0.387s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:13 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 is being set with open permissions: ugo+rw
Sep 22 15:57:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:13 devstack sudo[106576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449
Sep 22 15:57:13 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:13 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449" returned: 0 in 0.293s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:13 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:13 devstack sudo[106579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.info
Sep 22 15:57:13 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:14 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.info" returned: 0 in 0.458s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:14 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.info is being set with open permissions: ugo+rw
Sep 22 15:57:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:14 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.info
Sep 22 15:57:14 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:14 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.info" returned: 0 in 0.385s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:14 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:14 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-a5e3864b-5c8c-48e2-a9b4-4defa1333a7f tempest-ProjectMemberTests-1212956627 None] Create snapshot completed successfully
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Flow 'volume_create_manager' (d4c5d1e3-f661-440a-adad-9843ed21bb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b6a248-c05b-4ff4-ab26-9f09a0411691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b6a248-c05b-4ff4-ab26-9f09a0411691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-398484281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79be7103-ab93-4122-a693-23fd836e987a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40f301af887449681710277d800cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:15Z,use_quota=True,user_id='2e3f264ca2404896ad7d97f4b0594480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf5d51-4fcd-4eac-80ce-71c2011454c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf5d51-4fcd-4eac-80ce-71c2011454c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e103d27d-5ea2-4675-942e-42d159adc2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e103d27d-5ea2-4675-942e-42d159adc2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79be7103-ab93-4122-a693-23fd836e987a', 'volume_name': 'volume-79be7103-ab93-4122-a693-23fd836e987a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c331df-8120-4c25-989b-ab62a58dc7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c331df-8120-4c25-989b-ab62a58dc7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a12c09e-b1bb-470b-b407-738bf284e02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:15 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Volume 79be7103-ab93-4122-a693-23fd836e987a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79be7103-ab93-4122-a693-23fd836e987a', 'volume_size': 1}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-398484281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79be7103-ab93-4122-a693-23fd836e987a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40f301af887449681710277d800cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:15Z,use_quota=True,user_id='2e3f264ca2404896ad7d97f4b0594480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Creating volume 79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:57:15 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:15 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a 1073741824
Sep 22 15:57:15 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-5a1e3475-3f46-4a1a-b4d9-19fc734ca449-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-5a1e3475-3f46-4a1a-b4d9-19fc734ca449-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-5a1e3475-3f46-4a1a-b4d9-19fc734ca449" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-5a1e3475-3f46-4a1a-b4d9-19fc734ca449" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Deleting offline snapshot 5a1e3475-3f46-4a1a-b4d9-19fc734ca449 of volume f4c880a9-789f-4d72-8f58-6dcdbf500b2a {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] snapshot_file for this snap is: volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[db07d1f5-2504-4a1d-874b-7d9222b48a19]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:15 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449
Sep 22 15:57:15 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:15 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a 1073741824" returned: 0 in 0.442s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:15 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a
Sep 22 15:57:15 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:15 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449" returned: 0 in 0.391s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bd2a0a-2155-4beb-a28b-399e9006259d]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:15 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a" returned: 0 in 0.262s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a12c09e-b1bb-470b-b407-738bf284e02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79be7103-ab93-4122-a693-23fd836e987a', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:15 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d12f14d-b07e-4c69-85d2-a5f0f71e2710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:15 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a
Sep 22 15:57:16 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Volume volume-79be7103-ab93-4122-a693-23fd836e987a (79be7103-ab93-4122-a693-23fd836e987a): created successfully
Sep 22 15:57:16 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d12f14d-b07e-4c69-85d2-a5f0f71e2710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Flow 'volume_create_manager' (d4c5d1e3-f661-440a-adad-9843ed21bb43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:16 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-18a71553-3c67-4967-8a18-cceb61a71b0b tempest-SnapshotDependencyTests-2133022702 None] Created volume successfully.
Sep 22 15:57:16 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" returned: 0 in 0.377s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:16 devstack sudo[106640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449
Sep 22 15:57:16 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Creating offline snapshot fafa33d8-e250-44b2-9fc4-1d3529ba677a of volume 79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27847ce-cbdb-4895-a3d4-a38df7f7243f]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:16 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a
Sep 22 15:57:16 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:16 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449" returned: 0 in 0.351s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:16 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449
Sep 22 15:57:16 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:16 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a" returned: 0 in 0.377s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a 1G {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:16 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a 1G
Sep 22 15:57:16 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:16 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a.5a1e3475-3f46-4a1a-b4d9-19fc734ca449" returned: 0 in 0.259s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-5a1e3475-3f46-4a1a-b4d9-19fc734ca449" released by "_delete_snapshot" :: held 1.498s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" released by "delete_snapshot" :: held 1.523s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:16 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Created reservations ['dba0f1b7-aca0-4490-8a0c-d7fc88e37365', 'fa692ba5-39df-46e7-97e0-830ad35553cd', 'cb11453a-b7c8-495d-8dce-d6431b0d4d36', '9a1d0e33-4ea8-4045-b0b4-27f8ccd8a9df'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:17 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Delete snapshot completed successfully.
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-4ce5fc94-4eb8-4dea-9c41-dd440c242f28 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-5a1e3475-3f46-4a1a-b4d9-19fc734ca449-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:17 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a 1G" returned: 0 in 0.421s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79be7103-ab93-4122-a693-23fd836e987a -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:17 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79be7103-ab93-4122-a693-23fd836e987a -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a
Sep 22 15:57:17 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:17 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-f4c880a9-789f-4d72-8f58-6dcdbf500b2a-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79be7103-ab93-4122-a693-23fd836e987a -F qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a" returned: 0 in 0.302s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:17 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a is being set with open permissions: ugo+rw
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-f4c880a9-789f-4d72-8f58-6dcdbf500b2a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:17 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a
Sep 22 15:57:17 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "cinder-quobyte-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8570ed9b-d98b-4f64-8d77-02093a2a1d80]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:17 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a
Sep 22 15:57:17 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:17 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a" returned: 0 in 0.262s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:17 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:17 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.info
Sep 22 15:57:17 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:18 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" returned: 0 in 0.388s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:18 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a
Sep 22 15:57:18 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:18 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.info" returned: 0 in 0.263s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:18 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.info is being set with open permissions: ugo+rw
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.info {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:18 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.info
Sep 22 15:57:18 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:18 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" returned: 0 in 0.274s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:18 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.info" returned: 0 in 0.250s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-quobyte-f4c880a9-789f-4d72-8f58-6dcdbf500b2a" released by "delete_volume" :: held 0.752s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-ebc18c5c-4dd1-447f-a18b-fe48c270c4e6 tempest-SnapshotDependencyTests-2133022702 None] Create snapshot completed successfully
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Created reservations ['4b67593d-b891-477f-9357-6f32a10c63cd', 'd9fe8ea1-1f45-486f-bd0d-59f83ea45d64', '0e9c1426-89ba-4a85-bf45-a4a0164e033d', 'd645be1b-5e99-4d1a-b5de-cab7c864ccef'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:18 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:57:18 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:18 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.273s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:57:18 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Deleted volume successfully.
Sep 22 15:57:18 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-9bbfb172-767c-4ffd-96fd-00ffe83a7862 tempest-ProjectMemberTests-1212956627 None] Lock "cinder-f4c880a9-789f-4d72-8f58-6dcdbf500b2a-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Flow 'volume_create_manager' (0177d1c3-7f25-4718-b1bd-b78d5203b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb6eb02-0f9c-4fdd-8e2d-43a8d96a6a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb6eb02-0f9c-4fdd-8e2d-43a8d96a6a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56104b3f-2414-4b5d-905e-158ad051dbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40f301af887449681710277d800cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fafa33d8-e250-44b2-9fc4-1d3529ba677a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:19Z,use_quota=True,user_id='2e3f264ca2404896ad7d97f4b0594480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221e1e6f-4b05-4e5c-b033-1a5a5630817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221e1e6f-4b05-4e5c-b033-1a5a5630817b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2460aa-3a45-4aa8-95b3-42988a0ae110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2460aa-3a45-4aa8-95b3-42988a0ae110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '56104b3f-2414-4b5d-905e-158ad051dbf6', 'volume_name': 'volume-56104b3f-2414-4b5d-905e-158ad051dbf6', 'volume_size': 1, 'snapshot_id': 'fafa33d8-e250-44b2-9fc4-1d3529ba677a'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052ed749-b70c-4102-b9c5-436eb37d64c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052ed749-b70c-4102-b9c5-436eb37d64c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c18739-b0be-47d2-8e44-a509b314f186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:19 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Volume 56104b3f-2414-4b5d-905e-158ad051dbf6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-56104b3f-2414-4b5d-905e-158ad051dbf6', 'volume_size': 1, 'snapshot_id': 'fafa33d8-e250-44b2-9fc4-1d3529ba677a'}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "cinder-quobyte-fafa33d8-e250-44b2-9fc4-1d3529ba677a-56104b3f-2414-4b5d-905e-158ad051dbf6" by "_create_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-fafa33d8-e250-44b2-9fc4-1d3529ba677a-56104b3f-2414-4b5d-905e-158ad051dbf6" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Creating volume 56104b3f-2414-4b5d-905e-158ad051dbf6 from snapshot fafa33d8-e250-44b2-9fc4-1d3529ba677a {{(pid=85987) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "cinder-quobyte-56104b3f-2414-4b5d-905e-158ad051dbf6" by "_copy_volume_from_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-56104b3f-2414-4b5d-905e-158ad051dbf6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] snapshot: fafa33d8-e250-44b2-9fc4-1d3529ba677a, volume: 56104b3f-2414-4b5d-905e-158ad051dbf6,  {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9799562-6714-486c-9857-0e20e568b839]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:19 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a
Sep 22 15:57:19 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:19 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a" returned: 0 in 0.384s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79be7103-ab93-4122-a693-23fd836e987a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a839961-35bd-45bf-91e7-27039e569db9]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:19 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:19 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a
Sep 22 15:57:19 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:20 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a" returned: 0 in 0.423s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 22 15:57:20 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Creating direct copy from snapshot {{(pid=85987) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 22 15:57:20 devstack cinder-volume[85987]: DEBUG cinder.utils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Path /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6 not found in is_blk_device check {{(pid=85987) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 22 15:57:20 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:20 devstack sudo[106694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6
Sep 22 15:57:20 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:26 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:26 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6" returned: 0 in 6.788s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:26 devstack cinder-volume[85987]: DEBUG cinder.image.image_utils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Image conversion details: src /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6 {{(pid=85987) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 22 15:57:26 devstack cinder-volume[85987]: INFO cinder.image.image_utils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Converted 1024.00 MB image at 150.83 MB/s
Sep 22 15:57:26 devstack cinder-volume[85987]: WARNING cinder.volume.drivers.remotefs [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6 is being set with open permissions: ugo+rw
Sep 22 15:57:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:27 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6
Sep 22 15:57:27 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:27 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6" returned: 0 in 0.241s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-56104b3f-2414-4b5d-905e-158ad051dbf6" released by "_copy_volume_from_snapshot" :: held 7.931s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:27 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-fafa33d8-e250-44b2-9fc4-1d3529ba677a-56104b3f-2414-4b5d-905e-158ad051dbf6" released by "_create_volume_from_snapshot" :: held 7.993s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:27 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c18739-b0be-47d2-8e44-a509b314f186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56104b3f-2414-4b5d-905e-158ad051dbf6', 'volume_size': 1, 'snapshot_id': 'fafa33d8-e250-44b2-9fc4-1d3529ba677a'}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a210d19-a8f5-4aa4-bdd9-b578f5bc17fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:27 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Volume volume-56104b3f-2414-4b5d-905e-158ad051dbf6 (56104b3f-2414-4b5d-905e-158ad051dbf6): created successfully
Sep 22 15:57:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a210d19-a8f5-4aa4-bdd9-b578f5bc17fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:27 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Flow 'volume_create_manager' (0177d1c3-7f25-4718-b1bd-b78d5203b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:27 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-cfe05cdc-deb4-45c1-a130-59a2d85497cb tempest-SnapshotDependencyTests-2133022702 None] Created volume successfully.
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "cinder-fafa33d8-e250-44b2-9fc4-1d3529ba677a-delete_snapshot" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-fafa33d8-e250-44b2-9fc4-1d3529ba677a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "cinder-quobyte-79be7103-ab93-4122-a693-23fd836e987a" by "delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-79be7103-ab93-4122-a693-23fd836e987a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "cinder-quobyte-fafa33d8-e250-44b2-9fc4-1d3529ba677a" by "_delete_snapshot" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-fafa33d8-e250-44b2-9fc4-1d3529ba677a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Deleting offline snapshot fafa33d8-e250-44b2-9fc4-1d3529ba677a of volume 79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] snapshot_file for this snap is: volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a {{(pid=85987) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae11f51f-32c9-459b-b457-f5227c040afc]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:28 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a
Sep 22 15:57:28 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:28 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a" returned: 0 in 0.389s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79be7103-ab93-4122-a693-23fd836e987a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85987) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6d3144-4305-434e-bfc1-58cdcae1307c]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:28 devstack sudo[106722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a
Sep 22 15:57:28 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:28 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:57:28 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:29 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.249s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 29 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>, <Thread(Rabbit-heartbeat, started daemon 139419795786048)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 22 15:57:29 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a" returned: 0 in 0.572s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:29 devstack sudo[106730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a
Sep 22 15:57:29 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:29 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a" returned: 0 in 0.313s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:29 devstack sudo[106736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a
Sep 22 15:57:29 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:29 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a.fafa33d8-e250-44b2-9fc4-1d3529ba677a" returned: 0 in 0.237s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-fafa33d8-e250-44b2-9fc4-1d3529ba677a" released by "_delete_snapshot" :: held 1.636s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-79be7103-ab93-4122-a693-23fd836e987a" released by "delete_snapshot" :: held 1.662s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Created reservations ['4c48c02d-a89e-4aff-a2fd-8b1a328fd3d4', 'c0d06785-692b-48d8-8966-24cfd32a3463', 'd34bd85b-186b-4eae-afb7-a5f456daa391', 'd9f24052-d55b-4f3e-8503-0a81b0aebca5'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:29 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Delete snapshot completed successfully.
Sep 22 15:57:29 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-29b2b25a-aa5c-4837-91e1-7cf8283b6a53 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-fafa33d8-e250-44b2-9fc4-1d3529ba677a-delete_snapshot" released by "delete_snapshot" :: held 1.803s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "cinder-79be7103-ab93-4122-a693-23fd836e987a-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-79be7103-ab93-4122-a693-23fd836e987a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "cinder-quobyte-79be7103-ab93-4122-a693-23fd836e987a" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:30 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-79be7103-ab93-4122-a693-23fd836e987a" acquired by "delete_volume" :: waited 0.017s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:30 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[629fc3dd-45d5-46cc-b730-f52d3864edfc]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:30 devstack sudo[106739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a
Sep 22 15:57:30 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:30 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a" returned: 0 in 0.365s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:30 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a
Sep 22 15:57:30 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:30 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:30 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-79be7103-ab93-4122-a693-23fd836e987a" returned: 0 in 0.261s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-79be7103-ab93-4122-a693-23fd836e987a" released by "delete_volume" :: held 0.701s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Created reservations ['595e8ec6-f21f-419f-8910-3d8e13cedfb2', 'af473af7-7337-45e1-b251-2a134730ce3a', '1e339b53-ff7d-47ab-b851-4742a79e33c6', 'c427937c-c3f9-4f03-92fb-a60c20cd9c1a'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:31 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:57:31 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "cinder-56104b3f-2414-4b5d-905e-158ad051dbf6-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-56104b3f-2414-4b5d-905e-158ad051dbf6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:31 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.311s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:57:31 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Deleted volume successfully.
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "cinder-quobyte-56104b3f-2414-4b5d-905e-158ad051dbf6" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-56104b3f-2414-4b5d-905e-158ad051dbf6" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-786024aa-3cc7-4694-93d2-cf9c99d20330 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-79be7103-ab93-4122-a693-23fd836e987a-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc793f37-416e-4c4e-bc2e-b46abdf6327e]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:31 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6
Sep 22 15:57:31 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:31 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6" returned: 0 in 0.411s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:31 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:31 devstack sudo[106756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6
Sep 22 15:57:31 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:32 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-56104b3f-2414-4b5d-905e-158ad051dbf6" returned: 0 in 0.259s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-quobyte-56104b3f-2414-4b5d-905e-158ad051dbf6" released by "delete_volume" :: held 0.719s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Created reservations ['49fc5a3a-153d-4565-92b0-6a2f072e3f00', '0dd02f8d-06d5-42ea-95fd-119ad569f149', 'cd155018-1beb-4cb1-99b2-6354f5ded143', 'a609a3ba-cd80-425d-8a11-284a4e5ae105'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:32 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:57:32 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:32 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.260s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:57:32 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Deleted volume successfully.
Sep 22 15:57:32 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-c09795d0-8316-4985-a7f9-80cc93221de9 tempest-SnapshotDependencyTests-2133022702 None] Lock "cinder-56104b3f-2414-4b5d-905e-158ad051dbf6-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Flow 'volume_create_manager' (126154ef-3f42-4e6e-8e76-5ee64dba78c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101c82d8-ec91-455e-b1be-5e9028d45a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101c82d8-ec91-455e-b1be-5e9028d45a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892902555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd75b87-5afb-4932-8439-9e5341f8d1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9d79bb8b514a6696069517d027c133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:34Z,use_quota=True,user_id='9bc4c150abbb4d3092655ae7ff219ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97159e82-e782-41c6-9c1c-e1dcefd436a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97159e82-e782-41c6-9c1c-e1dcefd436a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e59d0a-233e-4406-b399-5bc298e7c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e59d0a-233e-4406-b399-5bc298e7c733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd75b87-5afb-4932-8439-9e5341f8d1e5', 'volume_name': 'volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb9f66c-19bc-4483-90c3-d7b4e6c4744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb9f66c-19bc-4483-90c3-d7b4e6c4744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4616db-ee6d-4f90-b9ad-a56b2eeceb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:34 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Volume 9bd75b87-5afb-4932-8439-9e5341f8d1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5', 'volume_size': 1}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892902555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd75b87-5afb-4932-8439-9e5341f8d1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9d79bb8b514a6696069517d027c133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:34Z,use_quota=True,user_id='9bc4c150abbb4d3092655ae7ff219ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Creating volume 9bd75b87-5afb-4932-8439-9e5341f8d1e5 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:57:34 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:34 devstack sudo[106763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5 1073741824
Sep 22 15:57:34 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:34 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5 1073741824" returned: 0 in 0.446s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:34 devstack sudo[106769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5
Sep 22 15:57:34 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:34 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5" returned: 0 in 0.263s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4616db-ee6d-4f90-b9ad-a56b2eeceb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:34 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650e60ed-614b-4d4c-b60f-00e94fe9e024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:35 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Volume volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5 (9bd75b87-5afb-4932-8439-9e5341f8d1e5): created successfully
Sep 22 15:57:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650e60ed-614b-4d4c-b60f-00e94fe9e024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:35 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Flow 'volume_create_manager' (126154ef-3f42-4e6e-8e76-5ee64dba78c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:35 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-c699f374-e38e-4697-8304-77f39c43c769 tempest-ProjectReaderTests-1262970490 None] Created volume successfully.
Sep 22 15:57:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Acquiring lock "cinder-9bd75b87-5afb-4932-8439-9e5341f8d1e5-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Lock "cinder-9bd75b87-5afb-4932-8439-9e5341f8d1e5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Acquiring lock "cinder-quobyte-9bd75b87-5afb-4932-8439-9e5341f8d1e5" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:36 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Lock "cinder-quobyte-9bd75b87-5afb-4932-8439-9e5341f8d1e5" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:36 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a5a976-b482-4831-bd8b-3ba7544ace55]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:36 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5
Sep 22 15:57:36 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:36 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5" returned: 0 in 0.389s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:36 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:36 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5
Sep 22 15:57:36 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:37 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9bd75b87-5afb-4932-8439-9e5341f8d1e5" returned: 0 in 0.322s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Lock "cinder-quobyte-9bd75b87-5afb-4932-8439-9e5341f8d1e5" released by "delete_volume" :: held 0.771s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Created reservations ['ae1f173a-245c-41dd-87cb-7607d4b02b6b', 'f246b26b-d38a-4cac-8c81-0d198e8764a3', 'f7056359-cac9-489c-a550-3a308975a693', '1421d555-41a2-4868-bc2c-23b558e0ef8c'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:37 devstack sudo[106782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:57:37 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:37 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.278s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:57:37 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Deleted volume successfully.
Sep 22 15:57:37 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-114aa3d5-1f00-4321-b295-49d3b1434e1c tempest-ProjectReaderTests-1262970490 None] Lock "cinder-9bd75b87-5afb-4932-8439-9e5341f8d1e5-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Flow 'volume_create_manager' (a5a690f2-5d3b-4b8e-b0b8-0bbaa0549dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1adcc7f3-61a0-4c60-8637-f02aefcefeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1adcc7f3-61a0-4c60-8637-f02aefcefeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699480357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edae34b0-c200-4d2d-b4de-f0cef84c4199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9d79bb8b514a6696069517d027c133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:38Z,use_quota=True,user_id='9bc4c150abbb4d3092655ae7ff219ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9f95ae-5944-4aa8-8bf1-49344fd40661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9f95ae-5944-4aa8-8bf1-49344fd40661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea263f2-9f0d-459f-810f-7915e3e58586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea263f2-9f0d-459f-810f-7915e3e58586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edae34b0-c200-4d2d-b4de-f0cef84c4199', 'volume_name': 'volume-edae34b0-c200-4d2d-b4de-f0cef84c4199', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9793b970-fbd7-4700-b682-c31f844d3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9793b970-fbd7-4700-b682-c31f844d3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346378cf-c714-4e9d-b74d-1e75f0c3b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Volume edae34b0-c200-4d2d-b4de-f0cef84c4199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edae34b0-c200-4d2d-b4de-f0cef84c4199', 'volume_size': 1}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699480357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edae34b0-c200-4d2d-b4de-f0cef84c4199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9d79bb8b514a6696069517d027c133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:38Z,use_quota=True,user_id='9bc4c150abbb4d3092655ae7ff219ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Creating volume edae34b0-c200-4d2d-b4de-f0cef84c4199 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:57:38 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:38 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199 1073741824
Sep 22 15:57:38 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:38 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199 1073741824" returned: 0 in 0.424s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:38 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199
Sep 22 15:57:38 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:38 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199" returned: 0 in 0.262s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346378cf-c714-4e9d-b74d-1e75f0c3b185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edae34b0-c200-4d2d-b4de-f0cef84c4199', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e71e861-528e-45c5-9efa-9b6016cd9e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:38 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Volume volume-edae34b0-c200-4d2d-b4de-f0cef84c4199 (edae34b0-c200-4d2d-b4de-f0cef84c4199): created successfully
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e71e861-528e-45c5-9efa-9b6016cd9e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:38 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Flow 'volume_create_manager' (a5a690f2-5d3b-4b8e-b0b8-0bbaa0549dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:38 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-40f746d1-309b-4873-a3f3-fc2041605298 tempest-ProjectReaderTests-1262970490 None] Created volume successfully.
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Acquiring lock "cinder-edae34b0-c200-4d2d-b4de-f0cef84c4199-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Lock "cinder-edae34b0-c200-4d2d-b4de-f0cef84c4199-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Acquiring lock "cinder-quobyte-edae34b0-c200-4d2d-b4de-f0cef84c4199" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Lock "cinder-quobyte-edae34b0-c200-4d2d-b4de-f0cef84c4199" acquired by "delete_volume" :: waited 0.022s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[72be4cf9-dd09-43c8-83da-42cabebf3f93]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:39 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199
Sep 22 15:57:39 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:39 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199" returned: 0 in 0.368s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:39 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199
Sep 22 15:57:39 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:39 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-edae34b0-c200-4d2d-b4de-f0cef84c4199" returned: 0 in 0.251s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Lock "cinder-quobyte-edae34b0-c200-4d2d-b4de-f0cef84c4199" released by "delete_volume" :: held 0.668s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Created reservations ['14f677ac-f822-4231-b53e-fe42525a8290', 'f07dd908-712a-4ddb-b65c-ce638446133c', '2acf0e59-223b-4e34-a57a-751f2c8513b0', '92cb9172-0f43-47ab-8390-e2efb843f00a'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:39 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:39 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:57:39 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:40 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:40 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.240s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:40 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:57:40 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Deleted volume successfully.
Sep 22 15:57:40 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-3e63f433-4b05-4f78-bd6b-b13cbf4c1bda tempest-ProjectReaderTests-1262970490 None] Lock "cinder-edae34b0-c200-4d2d-b4de-f0cef84c4199-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:49 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=46,cinder:INSERT=16,cinder:UPDATE=71,cinder:DELETE=8 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:57:50 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=66,cinder:SELECT=57,cinder:INSERT=19,cinder:DELETE=4 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Flow 'volume_create_manager' (046bf9e6-0677-4792-bfd0-6ff4e2e1f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452ffddd-9f3f-475e-bd37-e141f4ee4240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452ffddd-9f3f-475e-bd37-e141f4ee4240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892526800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8213c678-dea0-45aa-98c6-dcc77d917d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03383c4ad01d4897b6a07b1977df27eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:57Z,use_quota=True,user_id='5af6d49be5f0468587d37f427c5f4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cb5908-75b9-4206-adf8-93db704f1527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cb5908-75b9-4206-adf8-93db704f1527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016837db-9d8d-494f-8650-67e6b3e48e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016837db-9d8d-494f-8650-67e6b3e48e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8213c678-dea0-45aa-98c6-dcc77d917d27', 'volume_name': 'volume-8213c678-dea0-45aa-98c6-dcc77d917d27', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2e0cab-ec80-4be3-b035-c80ec3576dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2e0cab-ec80-4be3-b035-c80ec3576dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932aa54e-8c73-48be-8ea1-73d01fc1bdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:56 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Volume 8213c678-dea0-45aa-98c6-dcc77d917d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8213c678-dea0-45aa-98c6-dcc77d917d27', 'volume_size': 1}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892526800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8213c678-dea0-45aa-98c6-dcc77d917d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03383c4ad01d4897b6a07b1977df27eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:57Z,use_quota=True,user_id='5af6d49be5f0468587d37f427c5f4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Creating volume 8213c678-dea0-45aa-98c6-dcc77d917d27 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:57:56 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:57:56 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:56 devstack sudo[106812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27 1073741824
Sep 22 15:57:56 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:57 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27 1073741824" returned: 0 in 0.413s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:57 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27
Sep 22 15:57:57 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:57 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27" returned: 0 in 0.263s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932aa54e-8c73-48be-8ea1-73d01fc1bdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8213c678-dea0-45aa-98c6-dcc77d917d27', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41714068-d82d-493d-b139-d9c7512446ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:57 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Volume volume-8213c678-dea0-45aa-98c6-dcc77d917d27 (8213c678-dea0-45aa-98c6-dcc77d917d27): created successfully
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41714068-d82d-493d-b139-d9c7512446ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Flow 'volume_create_manager' (046bf9e6-0677-4792-bfd0-6ff4e2e1f187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:57 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-4f70043b-0fd7-467b-9a9e-27bdb2bbebd1 tempest-ProjectReaderTests-444893965 None] Created volume successfully.
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Acquiring lock "cinder-8213c678-dea0-45aa-98c6-dcc77d917d27-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Lock "cinder-8213c678-dea0-45aa-98c6-dcc77d917d27-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Acquiring lock "cinder-quobyte-8213c678-dea0-45aa-98c6-dcc77d917d27" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Lock "cinder-quobyte-8213c678-dea0-45aa-98c6-dcc77d917d27" acquired by "delete_volume" :: waited 0.014s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710ca41-a698-4355-bec8-ffddc1cab188]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:57:57 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:57 devstack sudo[106821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27
Sep 22 15:57:57 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:58 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27" returned: 0 in 0.400s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:58 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27
Sep 22 15:57:58 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:58 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-8213c678-dea0-45aa-98c6-dcc77d917d27" returned: 0 in 0.247s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Lock "cinder-quobyte-8213c678-dea0-45aa-98c6-dcc77d917d27" released by "delete_volume" :: held 0.690s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Created reservations ['35e5153b-65cf-4eae-bafa-2fecccb3071d', '9f0b6a68-b7a8-4543-8fcf-c4973eccd11f', '74040cc5-dd97-45e3-953a-ecfa1a88cbdf', '28225b6d-106b-4a4b-988b-329d2562afe1'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:58 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:57:58 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:58 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.246s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:57:58 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Deleted volume successfully.
Sep 22 15:57:58 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-bb45887a-7b54-4645-9748-22b0ace692ff tempest-ProjectReaderTests-444893965 None] Lock "cinder-8213c678-dea0-45aa-98c6-dcc77d917d27-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Flow 'volume_create_manager' (85b88ca2-de06-432d-b7ec-df27f6b7ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbc153f-be68-4fa1-b63e-7d01a2730586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbc153f-be68-4fa1-b63e-7d01a2730586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763108341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4345f6ae-e3f4-4f37-b407-cdf8cd362390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03383c4ad01d4897b6a07b1977df27eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:59Z,use_quota=True,user_id='5af6d49be5f0468587d37f427c5f4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda26a13-6d16-4b5b-b7ae-5a9dda6686ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda26a13-6d16-4b5b-b7ae-5a9dda6686ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcfe8f5-0176-4244-abb6-6a16d1e14abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcfe8f5-0176-4244-abb6-6a16d1e14abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4345f6ae-e3f4-4f37-b407-cdf8cd362390', 'volume_name': 'volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa588ac-ef36-421d-9071-a0ea092d1264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa588ac-ef36-421d-9071-a0ea092d1264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa422270-fd78-4c07-9a21-1cb50d92ed04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:57:59 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Volume 4345f6ae-e3f4-4f37-b407-cdf8cd362390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390', 'volume_size': 1}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763108341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4345f6ae-e3f4-4f37-b407-cdf8cd362390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03383c4ad01d4897b6a07b1977df27eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:57:59Z,use_quota=True,user_id='5af6d49be5f0468587d37f427c5f4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Creating volume 4345f6ae-e3f4-4f37-b407-cdf8cd362390 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:57:59 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:59 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390 1073741824
Sep 22 15:57:59 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:57:59 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390 1073741824" returned: 0 in 0.422s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:57:59 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:57:59 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390
Sep 22 15:57:59 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:00 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390" returned: 0 in 0.244s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa422270-fd78-4c07-9a21-1cb50d92ed04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff708d8-f824-4f65-8148-ab2fb978664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:00 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Volume volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390 (4345f6ae-e3f4-4f37-b407-cdf8cd362390): created successfully
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff708d8-f824-4f65-8148-ab2fb978664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Flow 'volume_create_manager' (85b88ca2-de06-432d-b7ec-df27f6b7ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:58:00 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-d3195da1-4a39-428a-ac8b-c188866d05a7 tempest-ProjectReaderTests-444893965 None] Created volume successfully.
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Acquiring lock "cinder-4345f6ae-e3f4-4f37-b407-cdf8cd362390-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Lock "cinder-4345f6ae-e3f4-4f37-b407-cdf8cd362390-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Acquiring lock "cinder-quobyte-4345f6ae-e3f4-4f37-b407-cdf8cd362390" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Lock "cinder-quobyte-4345f6ae-e3f4-4f37-b407-cdf8cd362390" acquired by "delete_volume" :: waited 0.014s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[449fabcc-2c07-437c-932c-29b3976dcce2]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:00 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390
Sep 22 15:58:00 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:00 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390" returned: 0 in 0.348s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:00 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:00 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390
Sep 22 15:58:00 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:01 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-4345f6ae-e3f4-4f37-b407-cdf8cd362390" returned: 0 in 0.239s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Lock "cinder-quobyte-4345f6ae-e3f4-4f37-b407-cdf8cd362390" released by "delete_volume" :: held 0.628s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Created reservations ['156e2561-c05e-4b7a-9f01-9f282ca627d3', '5d8de0a3-32ad-4ce9-80c7-eb241da34f31', 'a4ca9486-aab6-4135-89ba-ed31fd3ed779', 'b1174699-5ca7-4d4d-b14e-584c8ea2e9ff'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:01 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:58:01 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:01 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.242s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:58:01 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Deleted volume successfully.
Sep 22 15:58:01 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-676ea23a-c23a-4947-a822-60a126c9a6f1 tempest-ProjectReaderTests-444893965 None] Lock "cinder-4345f6ae-e3f4-4f37-b407-cdf8cd362390-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Flow 'volume_create_manager' (1b573907-547d-4052-86f2-4e04cf089fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c155a745-e6dc-4338-a6d4-4b919d440f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c155a745-e6dc-4338-a6d4-4b919d440f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604226533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0b254f-82a8-4a35-907d-ca7b81302f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03383c4ad01d4897b6a07b1977df27eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:02Z,use_quota=True,user_id='5af6d49be5f0468587d37f427c5f4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e44cf9d-ef47-4a65-af3a-6cf30ef766b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e44cf9d-ef47-4a65-af3a-6cf30ef766b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768e195f-69a9-4362-b962-945a298a4292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768e195f-69a9-4362-b962-945a298a4292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0b254f-82a8-4a35-907d-ca7b81302f05', 'volume_name': 'volume-9e0b254f-82a8-4a35-907d-ca7b81302f05', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc849a1b-02ec-400f-b529-403b82de0013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc849a1b-02ec-400f-b529-403b82de0013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba9e49e-5738-4ef1-831b-163588a99c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:02 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Volume 9e0b254f-82a8-4a35-907d-ca7b81302f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0b254f-82a8-4a35-907d-ca7b81302f05', 'volume_size': 1}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604226533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0b254f-82a8-4a35-907d-ca7b81302f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03383c4ad01d4897b6a07b1977df27eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:02Z,use_quota=True,user_id='5af6d49be5f0468587d37f427c5f4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Creating volume 9e0b254f-82a8-4a35-907d-ca7b81302f05 {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:58:02 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:02 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05 1073741824
Sep 22 15:58:02 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:02 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05 1073741824" returned: 0 in 0.422s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:02 devstack sudo[106857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05
Sep 22 15:58:02 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:02 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05" returned: 0 in 0.253s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba9e49e-5738-4ef1-831b-163588a99c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0b254f-82a8-4a35-907d-ca7b81302f05', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192eea3e-653a-4e9a-ac62-840b2ef2017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:02 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Volume volume-9e0b254f-82a8-4a35-907d-ca7b81302f05 (9e0b254f-82a8-4a35-907d-ca7b81302f05): created successfully
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192eea3e-653a-4e9a-ac62-840b2ef2017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:02 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Flow 'volume_create_manager' (1b573907-547d-4052-86f2-4e04cf089fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:58:02 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-bec260c5-b373-4c4b-a194-bd17bb001d86 tempest-ProjectReaderTests-444893965 None] Created volume successfully.
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Acquiring lock "cinder-9e0b254f-82a8-4a35-907d-ca7b81302f05-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Lock "cinder-9e0b254f-82a8-4a35-907d-ca7b81302f05-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Acquiring lock "cinder-quobyte-9e0b254f-82a8-4a35-907d-ca7b81302f05" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Lock "cinder-quobyte-9e0b254f-82a8-4a35-907d-ca7b81302f05" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[04661c74-71fd-4098-9387-f493dde3796a]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:03 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05
Sep 22 15:58:03 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:03 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05" returned: 0 in 0.368s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:03 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05
Sep 22 15:58:03 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:03 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-9e0b254f-82a8-4a35-907d-ca7b81302f05" returned: 0 in 0.240s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Lock "cinder-quobyte-9e0b254f-82a8-4a35-907d-ca7b81302f05" released by "delete_volume" :: held 0.650s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Created reservations ['d51b52e6-cd87-44d7-9b02-860c3e360851', 'f2f3f616-0281-4e0e-be40-1c8c3651e653', '35e7a292-835a-42f1-80ab-55a2b3fa0824', '86125506-fc44-4031-a2b7-8c25dffaad32'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:58:03 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:03 devstack sudo[106868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:58:03 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:04 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.268s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:58:04 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Deleted volume successfully.
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7529ca56-f3a2-429f-a19d-51d22198289a tempest-ProjectReaderTests-444893965 None] Lock "cinder-9e0b254f-82a8-4a35-907d-ca7b81302f05-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.flows.manager.create_volume [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85987) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Flow 'volume_create_manager' (8066ebc8-2542-48fa-8549-12dbea9cb728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe45f81-5e46-4b38-9865-532de2e39245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe45f81-5e46-4b38-9865-532de2e39245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794012788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03383c4ad01d4897b6a07b1977df27eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:05Z,use_quota=True,user_id='5af6d49be5f0468587d37f427c5f4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa1540c-54aa-4752-9e82-db4b9a5e5388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa1540c-54aa-4752-9e82-db4b9a5e5388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3782c812-e978-410d-a0be-6f2c57975790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3782c812-e978-410d-a0be-6f2c57975790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e', 'volume_name': 'volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1d128b-0a94-4fe9-967c-7e6b77aff330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1d128b-0a94-4fe9-967c-7e6b77aff330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac4f17a-2074-4d8f-9fe5-77a065ee217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:04 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Volume ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e', 'volume_size': 1}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ecd3403d700>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794012788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03383c4ad01d4897b6a07b1977df27eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T13:58:05Z,use_quota=True,user_id='5af6d49be5f0468587d37f427c5f4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f7642e-7784-4ac2-b7ec-f2c7b74d43dd),volume_type_id=58f7642e-7784-4ac2-b7ec-f2c7b74d43dd)}" {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.remotefs [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Creating volume ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e {{(pid=85987) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Selected osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4 as target Quobyte volume. {{(pid=85987) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 22 15:58:04 devstack cinder-volume[85987]: INFO cinder.volume.drivers.remotefs [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] casted to osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4
Sep 22 15:58:04 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e 1073741824 {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:04 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e 1073741824
Sep 22 15:58:04 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:05 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e 1073741824" returned: 0 in 0.418s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:05 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e
Sep 22 15:58:05 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:05 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e" returned: 0 in 0.233s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'} {{(pid=85987) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac4f17a-2074-4d8f-9fe5-77a065ee217e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e', 'volume_size': 1}' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60373c17-004e-4dd6-9ffa-44869e6f82ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 22 15:58:05 devstack cinder-volume[85987]: INFO cinder.volume.flows.manager.create_volume [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Volume volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e (ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e): created successfully
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60373c17-004e-4dd6-9ffa-44869e6f82ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85987) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Flow 'volume_create_manager' (8066ebc8-2542-48fa-8549-12dbea9cb728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85987) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 22 15:58:05 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-674dfe87-ae69-439f-b2bb-8db7cce67431 tempest-ProjectReaderTests-444893965 None] Created volume successfully.
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Acquiring lock "cinder-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e-delete_volume" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Lock "cinder-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Acquiring lock "cinder-quobyte-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e" by "delete_volume" {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Lock "cinder-quobyte-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e" acquired by "delete_volume" :: waited 0.015s {{(pid=85987) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e422441-3d90-4c9f-86d4-ae6c95546580]: (4, 'qcow2') {{(pid=87525) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 22 15:58:05 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:05 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e
Sep 22 15:58:05 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:06 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e" returned: 0 in 0.367s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:06 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e
Sep 22 15:58:06 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:06 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f/volume-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e" returned: 0 in 0.245s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Lock "cinder-quobyte-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e" released by "delete_volume" :: held 0.652s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG cinder.quota [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Created reservations ['9efe4cfe-feaa-4170-a6f3-d086513a47bf', 'df64a286-9cf0-40db-a838-680f8cdecc64', '81715ca0-9541-497f-879c-454930c0df3e', '108e9307-5d8a-48a7-aae7-bb70ce35b970'] {{(pid=85987) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:06 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:58:06 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:06 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.239s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:58:06 devstack cinder-volume[85987]: INFO cinder.volume.manager [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Deleted volume successfully.
Sep 22 15:58:06 devstack cinder-volume[85987]: DEBUG cinder.coordination [None req-7f901a18-797d-4733-b3c7-7791058ef3d1 tempest-ProjectReaderTests-444893965 None] Lock "cinder-ba91bea8-2a6d-4e36-ac6c-6e04a59cf08e-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=85987) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 22 15:58:16 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:SELECT=28,cinder:UPDATE=45,cinder:INSERT=8,cinder:DELETE=5 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:58:16 devstack cinder-volume[85987]: DEBUG dbcounter [-] [85987] Writing DB stats cinder:UPDATE=43,cinder:SELECT=28,cinder:INSERT=12,cinder:DELETE=3 {{(pid=85987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 22 15:58:28 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:58:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 22 15:58:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 22 15:58:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4': None} {{(pid=85987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 22 15:58:28 devstack cinder-volume[85987]: DEBUG cinder.volume.drivers.quobyte [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7821b3f7-1076-430f-8165-dc8d7e6b93f4'] {{(pid=85987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 22 15:58:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.lockutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 22 15:58:28 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 22 15:58:28 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f
Sep 22 15:58:28 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 15:58:29 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Sep 22 15:58:29 devstack cinder-volume[85987]: DEBUG oslo_concurrency.processutils [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/589ae377e127da4c7e52e9069163c36f" returned: 0 in 0.257s {{(pid=85987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 22 15:58:29 devstack cinder-volume[85987]: DEBUG cinder.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Notifying Schedulers of capabilities ... {{(pid=85987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 22 15:58:29 devstack cinder-volume[85987]: DEBUG oslo_service.periodic_task [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] Running periodic task VolumeManager._thread_info {{(pid=85987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 22 15:58:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread count: 29 {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 22 15:58:29 devstack cinder-volume[85987]: DEBUG cinder.volume.manager [None req-7c3487ae-163d-46d3-aa0f-e61a9fa7069d None None] thread info: [<_MainThread(MainThread, started 139419920048256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139419805819904)>, <Thread(Thread-3 (stat_writer), started daemon 139419806680576)>, <Thread(Rabbit-heartbeat, started daemon 139419806681536)>, <Thread(Thread-5 (_runner), started daemon 139419803728960)>, <Thread(Thread-7 (_runner), started daemon 139419803793792)>, <Thread(fd_logger, started daemon 139419801378880)>, <Thread(privsep_reader, started daemon 139419803408704)>, <Thread(tpool_thread_0, started daemon 139419793995456)>, <Thread(tpool_thread_1, started daemon 139419785602752)>, <Thread(tpool_thread_2, started daemon 139419777210048)>, <Thread(tpool_thread_3, started daemon 139419768817344)>, <Thread(tpool_thread_4, started daemon 139419760424640)>, <Thread(tpool_thread_5, started daemon 139419752031936)>, <Thread(tpool_thread_6, started daemon 139419743639232)>, <Thread(tpool_thread_7, started daemon 139419735246528)>, <Thread(tpool_thread_8, started daemon 139419726853824)>, <Thread(tpool_thread_9, started daemon 139419718461120)>, <Thread(tpool_thread_10, started daemon 139419710068416)>, <Thread(tpool_thread_11, started daemon 139419701675712)>, <Thread(tpool_thread_12, started daemon 139419693283008)>, <Thread(tpool_thread_13, started daemon 139419684890304)>, <Thread(tpool_thread_14, started daemon 139419676497600)>, <Thread(tpool_thread_15, started daemon 139419668088512)>, <Thread(tpool_thread_16, started daemon 139419659679424)>, <Thread(tpool_thread_17, started daemon 139419651270336)>, <Thread(tpool_thread_18, started daemon 139419642861248)>, <Thread(tpool_thread_19, started daemon 139419634452160)>, <Thread(Rabbit-heartbeat, started daemon 139419795786048)>] {{(pid=85987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}